{
  "nbformat": 4,
  "nbformat_minor": 0,
  "metadata": {
    "colab": {
      "name": "cifar_training.ipynb",
      "provenance": [],
      "collapsed_sections": [],
      "toc_visible": true
    },
    "kernelspec": {
      "name": "python3",
      "display_name": "Python 3"
    },
    "accelerator": "GPU"
  },
  "cells": [
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "acshm9sK-WN1"
      },
      "source": [
        "# Training models on CIFAR-10/100 datasets, using ***torchdistill***"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "-an0T-1XAX5g"
      },
      "source": [
        "## 1. Make sure you have access to GPU/TPU\n",
        "Google Colab: *Runtime* -> *Change runtime type* -> *Hardware accelarator*: \"GPU\" or \"TPU\""
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "ng_tsTQEr3sa",
        "outputId": "0b54f53f-7d51-4b3c-d31a-0436c210c73c"
      },
      "source": [
        "!nvidia-smi"
      ],
      "execution_count": 1,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "Fri May 21 20:49:00 2021       \n",
            "+-----------------------------------------------------------------------------+\n",
            "| NVIDIA-SMI 465.19.01    Driver Version: 460.32.03    CUDA Version: 11.2     |\n",
            "|-------------------------------+----------------------+----------------------+\n",
            "| GPU  Name        Persistence-M| Bus-Id        Disp.A | Volatile Uncorr. ECC |\n",
            "| Fan  Temp  Perf  Pwr:Usage/Cap|         Memory-Usage | GPU-Util  Compute M. |\n",
            "|                               |                      |               MIG M. |\n",
            "|===============================+======================+======================|\n",
            "|   0  Tesla T4            Off  | 00000000:00:04.0 Off |                    0 |\n",
            "| N/A   49C    P8     9W /  70W |      0MiB / 15109MiB |      0%      Default |\n",
            "|                               |                      |                  N/A |\n",
            "+-------------------------------+----------------------+----------------------+\n",
            "                                                                               \n",
            "+-----------------------------------------------------------------------------+\n",
            "| Processes:                                                                  |\n",
            "|  GPU   GI   CI        PID   Type   Process name                  GPU Memory |\n",
            "|        ID   ID                                                   Usage      |\n",
            "|=============================================================================|\n",
            "|  No running processes found                                                 |\n",
            "+-----------------------------------------------------------------------------+\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "SI0y3xO_-gkJ"
      },
      "source": [
        "## 2. Install ***torchdistill***"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "id": "pJSCmbJH_yuC",
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "outputId": "c3710be9-d10d-43fa-faa4-9156adb7fd0e"
      },
      "source": [
        "!pip install torchdistill"
      ],
      "execution_count": 2,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "Collecting torchdistill\n",
            "\u001b[?25l  Downloading https://files.pythonhosted.org/packages/1d/1e/98c4591040d5ba7b849432e4bc6a575a8c87aa228fa043cbfb1ead9695be/torchdistill-0.2.0-py3-none-any.whl (78kB)\n",
            "\r\u001b[K     |████▏                           | 10kB 19.9MB/s eta 0:00:01\r\u001b[K     |████████▍                       | 20kB 19.0MB/s eta 0:00:01\r\u001b[K     |████████████▋                   | 30kB 16.6MB/s eta 0:00:01\r\u001b[K     |████████████████▉               | 40kB 15.0MB/s eta 0:00:01\r\u001b[K     |█████████████████████           | 51kB 7.1MB/s eta 0:00:01\r\u001b[K     |█████████████████████████▏      | 61kB 8.3MB/s eta 0:00:01\r\u001b[K     |█████████████████████████████▍  | 71kB 8.7MB/s eta 0:00:01\r\u001b[K     |████████████████████████████████| 81kB 5.6MB/s \n",
            "\u001b[?25hRequirement already satisfied: pycocotools>=2.0.1 in /usr/local/lib/python3.7/dist-packages (from torchdistill) (2.0.2)\n",
            "Collecting pyyaml>=5.4.1\n",
            "\u001b[?25l  Downloading https://files.pythonhosted.org/packages/7a/a5/393c087efdc78091afa2af9f1378762f9821c9c1d7a22c5753fb5ac5f97a/PyYAML-5.4.1-cp37-cp37m-manylinux1_x86_64.whl (636kB)\n",
            "\u001b[K     |████████████████████████████████| 645kB 33.7MB/s \n",
            "\u001b[?25hRequirement already satisfied: scipy in /usr/local/lib/python3.7/dist-packages (from torchdistill) (1.4.1)\n",
            "Requirement already satisfied: cython in /usr/local/lib/python3.7/dist-packages (from torchdistill) (0.29.23)\n",
            "Requirement already satisfied: torch>=1.7.1 in /usr/local/lib/python3.7/dist-packages (from torchdistill) (1.8.1+cu101)\n",
            "Requirement already satisfied: numpy in /usr/local/lib/python3.7/dist-packages (from torchdistill) (1.19.5)\n",
            "Requirement already satisfied: torchvision>=0.8.2 in /usr/local/lib/python3.7/dist-packages (from torchdistill) (0.9.1+cu101)\n",
            "Requirement already satisfied: setuptools>=18.0 in /usr/local/lib/python3.7/dist-packages (from pycocotools>=2.0.1->torchdistill) (56.1.0)\n",
            "Requirement already satisfied: matplotlib>=2.1.0 in /usr/local/lib/python3.7/dist-packages (from pycocotools>=2.0.1->torchdistill) (3.2.2)\n",
            "Requirement already satisfied: typing-extensions in /usr/local/lib/python3.7/dist-packages (from torch>=1.7.1->torchdistill) (3.7.4.3)\n",
            "Requirement already satisfied: pillow>=4.1.1 in /usr/local/lib/python3.7/dist-packages (from torchvision>=0.8.2->torchdistill) (7.1.2)\n",
            "Requirement already satisfied: pyparsing!=2.0.4,!=2.1.2,!=2.1.6,>=2.0.1 in /usr/local/lib/python3.7/dist-packages (from matplotlib>=2.1.0->pycocotools>=2.0.1->torchdistill) (2.4.7)\n",
            "Requirement already satisfied: cycler>=0.10 in /usr/local/lib/python3.7/dist-packages (from matplotlib>=2.1.0->pycocotools>=2.0.1->torchdistill) (0.10.0)\n",
            "Requirement already satisfied: python-dateutil>=2.1 in /usr/local/lib/python3.7/dist-packages (from matplotlib>=2.1.0->pycocotools>=2.0.1->torchdistill) (2.8.1)\n",
            "Requirement already satisfied: kiwisolver>=1.0.1 in /usr/local/lib/python3.7/dist-packages (from matplotlib>=2.1.0->pycocotools>=2.0.1->torchdistill) (1.3.1)\n",
            "Requirement already satisfied: six in /usr/local/lib/python3.7/dist-packages (from cycler>=0.10->matplotlib>=2.1.0->pycocotools>=2.0.1->torchdistill) (1.15.0)\n",
            "Installing collected packages: pyyaml, torchdistill\n",
            "  Found existing installation: PyYAML 3.13\n",
            "    Uninstalling PyYAML-3.13:\n",
            "      Successfully uninstalled PyYAML-3.13\n",
            "Successfully installed pyyaml-5.4.1 torchdistill-0.2.0\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "ekaJbQ3g-fa2"
      },
      "source": [
        "## 3. Clone ***torchdistill*** repository to use its example code and configuration files"
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "bYrQwcOa_r2P",
        "outputId": "9d458f41-95fd-48f3-b8c3-3cc81fa2c33d"
      },
      "source": [
        "!git clone https://github.com/yoshitomo-matsubara/torchdistill.git"
      ],
      "execution_count": 3,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "Cloning into 'torchdistill'...\n",
            "remote: Enumerating objects: 5065, done.\u001b[K\n",
            "remote: Counting objects: 100% (847/847), done.\u001b[K\n",
            "remote: Compressing objects: 100% (490/490), done.\u001b[K\n",
            "remote: Total 5065 (delta 487), reused 600 (delta 295), pack-reused 4218\u001b[K\n",
            "Receiving objects: 100% (5065/5065), 1.09 MiB | 13.29 MiB/s, done.\n",
            "Resolving deltas: 100% (3101/3101), done.\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "j0JxZZ4BAFpb"
      },
      "source": [
        "## 4. Train models on CIFAR-10"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "cMzEpVbNCtCE"
      },
      "source": [
        "Note that the hyperparameters of ResNet, WRN (Wide ResNet), and DenseNet-BC were chosen based on either train/val (splitting 50k samples into train:val = 45k:5k) or cross-validation, according to the original papers.  \n",
        "For the final run (once the hyperparameters are finalized), the authors used all the training images (50k samples).  \n",
        "- ResNet: https://github.com/facebookarchive/fb.resnet.torch\n",
        "- WRN (Wide ResNet): https://github.com/szagoruyko/wide-residual-networks\n",
        "- DenseNet-BC: https://github.com/liuzhuang13/DenseNet\n",
        "\n",
        "The following examples demonstrate how to 1) tune hyperparameter and 2) do final-run with ResNet-20 on CIFAR-10 dataset, respectively."
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "sx5VnugvS5nx"
      },
      "source": [
        "### 4.1 Hyperparameter tuning based on train:val = 45k:5k\n",
        "Let's start with a small model, ResNet-20, for tutorial.  \n",
        "\n",
        "Open `torchdistill/configs/sample/cifar10/ce/resnet20-hyperparameter_tuning.yaml` and update hyperparameters as you wish e.g., number of epochs (*num_epochs*), batch size (*batch_size* in *train_data_loader* entry), learning rate (*lr* within *optimizer* entry), and so on.  \n",
        "By default, the hyperparameters in the example config are identical to those in the final run config.\n",
        "  \n",
        "You will find a lot of module names from [PyTorch documentation](https://pytorch.org/docs/stable/index.html) and [torchvision](https://pytorch.org/docs/stable/torchvision/) such as [`SGD`](https://pytorch.org/docs/stable/optim.html#torch.optim.SGD), [`MultiStepLR`](https://pytorch.org/docs/stable/optim.html#torch.optim.lr_scheduler.MultiStepLR), [`CrossEntropyLoss`](https://pytorch.org/docs/stable/generated/torch.nn.CrossEntropyLoss.html#torch.nn.CrossEntropyLoss), [`CIFAR10`](https://pytorch.org/docs/stable/torchvision/datasets.html#torchvision.datasets.CIFAR10), [`RandomCrop`](https://pytorch.org/docs/stable/torchvision/transforms.html#torchvision.transforms.RandomCrop) (, and more). You can update their parameters or replace such modules with other modules in the packages. For instance, `SGD` could be replaced with [`Adam`](https://pytorch.org/docs/stable/optim.html#torch.optim.Adam), and then you will change the parameters under `params` (at least delete `momentum` entry as the parameter is not for `Adam`). "
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "t2vNdvtotXck",
        "outputId": "2e19833f-5613-4746-dec6-a9794944f0ac"
      },
      "source": [
        "!python torchdistill/examples/image_classification.py --config torchdistill/configs/sample/cifar10/ce/resnet20-hyperparameter_tuning.yaml --log log/cifar10/ce/resnet20-hyperparameter_tuning.log"
      ],
      "execution_count": 4,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "2021/05/21 20:49:41\tINFO\ttorchdistill.common.main_util\tNot using distributed mode\n",
            "2021/05/21 20:49:41\tINFO\t__main__\tNamespace(adjust_lr=False, config='torchdistill/configs/sample/cifar10/ce/resnet20-hyperparameter_tuning.yaml', device='cuda', dist_url='env://', log='log/cifar10/ce/resnet20-hyperparameter_tuning.log', seed=None, start_epoch=0, student_only=False, sync_bn=False, test_only=False, world_size=1)\n",
            "2021/05/21 20:49:41\tINFO\ttorchdistill.datasets.util\tLoading dummy data\n",
            "Downloading https://www.cs.toronto.edu/~kriz/cifar-10-python.tar.gz to ./resource/dataset/cifar10/cifar-10-python.tar.gz\n",
            "170499072it [00:03, 48999380.64it/s]                   \n",
            "Extracting ./resource/dataset/cifar10/cifar-10-python.tar.gz to ./resource/dataset/cifar10\n",
            "2021/05/21 20:49:49\tINFO\ttorchdistill.datasets.util\tSplitting `dummy` dataset (50000 samples in total)\n",
            "2021/05/21 20:49:49\tINFO\ttorchdistill.datasets.util\tnew dataset_id: `cifar10/train` (45000 samples)\n",
            "2021/05/21 20:49:49\tINFO\ttorchdistill.datasets.util\tnew dataset_id: `cifar10/val` (5000 samples)\n",
            "2021/05/21 20:49:49\tINFO\ttorchdistill.datasets.util\tdataset_id `dummy`: 7.398855209350586 sec\n",
            "2021/05/21 20:49:49\tINFO\ttorchdistill.datasets.util\tLoading test data\n",
            "Files already downloaded and verified\n",
            "2021/05/21 20:49:50\tINFO\ttorchdistill.datasets.util\tdataset_id `cifar10/test`: 0.7523047924041748 sec\n",
            "2021/05/21 20:49:50\tINFO\ttorchdistill.common.main_util\tckpt file is not found at `./resource/ckpt/cifar10/ce/cifar10-resnet20-hyperparameter_tuning.pt`\n",
            "2021/05/21 20:50:00\tINFO\t__main__\tStart training\n",
            "/usr/local/lib/python3.7/dist-packages/torch/utils/data/dataloader.py:477: UserWarning: This DataLoader will create 16 worker processes in total. Our suggested max number of worker in current system is 2, which is smaller than what this DataLoader is going to create. Please be aware that excessive worker creation might get DataLoader running slow or even freeze, lower the worker number to avoid potential slowness/freeze if necessary.\n",
            "  cpuset_checked))\n",
            "2021/05/21 20:50:00\tINFO\ttorchdistill.models.util\t[student model]\n",
            "2021/05/21 20:50:00\tINFO\ttorchdistill.models.util\tUsing the original student model\n",
            "2021/05/21 20:50:00\tINFO\ttorchdistill.core.training\tLoss = 1.0 * OrgLoss\n",
            "2021/05/21 20:50:02\tINFO\ttorchdistill.misc.log\tEpoch: [0]  [  0/352]  eta: 0:07:06  lr: 0.1  img/s: 280.11352908428853  loss: 2.3764 (2.3764)  time: 1.2122  data: 0.7552  max mem: 281\n",
            "2021/05/21 20:50:05\tINFO\ttorchdistill.misc.log\tEpoch: [0]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 5383.297857192993  loss: 1.5929 (1.8545)  time: 0.0309  data: 0.0039  max mem: 281\n",
            "2021/05/21 20:50:08\tINFO\ttorchdistill.misc.log\tEpoch: [0]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 4136.267003605658  loss: 1.3980 (1.6751)  time: 0.0299  data: 0.0034  max mem: 281\n",
            "2021/05/21 20:50:11\tINFO\ttorchdistill.misc.log\tEpoch: [0]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 5712.851281178173  loss: 1.2560 (1.5574)  time: 0.0309  data: 0.0035  max mem: 281\n",
            "2021/05/21 20:50:12\tINFO\ttorchdistill.misc.log\tEpoch: [0] Total time: 0:00:11\n",
            "2021/05/21 20:50:13\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 44.5312 (44.5312)  acc5: 89.8438 (89.8438)  time: 0.5549  data: 0.5167  max mem: 281\n",
            "2021/05/21 20:50:14\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 20:50:14\tINFO\t__main__\t * Acc@1 50.3000\tAcc@5 93.7800\n",
            "\n",
            "2021/05/21 20:50:14\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 0.0000 -> 50.3000)\n",
            "2021/05/21 20:50:15\tINFO\ttorchdistill.misc.log\tEpoch: [1]  [  0/352]  eta: 0:04:05  lr: 0.1  img/s: 1107.3841546172728  loss: 1.2212 (1.2212)  time: 0.6974  data: 0.5818  max mem: 281\n",
            "2021/05/21 20:50:18\tINFO\ttorchdistill.misc.log\tEpoch: [1]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 4609.798064621382  loss: 1.0541 (1.1063)  time: 0.0313  data: 0.0034  max mem: 281\n",
            "2021/05/21 20:50:21\tINFO\ttorchdistill.misc.log\tEpoch: [1]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 5344.498541606523  loss: 0.9921 (1.0684)  time: 0.0301  data: 0.0023  max mem: 281\n",
            "2021/05/21 20:50:24\tINFO\ttorchdistill.misc.log\tEpoch: [1]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 5257.3582718032085  loss: 0.9259 (1.0293)  time: 0.0311  data: 0.0050  max mem: 281\n",
            "2021/05/21 20:50:26\tINFO\ttorchdistill.misc.log\tEpoch: [1] Total time: 0:00:11\n",
            "2021/05/21 20:50:26\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:25  acc1: 52.3438 (52.3438)  acc5: 91.4062 (91.4062)  time: 0.6271  data: 0.5954  max mem: 281\n",
            "2021/05/21 20:50:27\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 20:50:27\tINFO\t__main__\t * Acc@1 63.0400\tAcc@5 96.5200\n",
            "\n",
            "2021/05/21 20:50:27\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 50.3000 -> 63.0400)\n",
            "2021/05/21 20:50:28\tINFO\ttorchdistill.misc.log\tEpoch: [2]  [  0/352]  eta: 0:03:50  lr: 0.1  img/s: 1167.4888431252732  loss: 0.9065 (0.9065)  time: 0.6560  data: 0.5463  max mem: 281\n",
            "2021/05/21 20:50:32\tINFO\ttorchdistill.misc.log\tEpoch: [2]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 3559.821448937101  loss: 0.8477 (0.8473)  time: 0.0324  data: 0.0033  max mem: 281\n",
            "2021/05/21 20:50:35\tINFO\ttorchdistill.misc.log\tEpoch: [2]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 5271.295577723667  loss: 0.7183 (0.8199)  time: 0.0302  data: 0.0027  max mem: 281\n",
            "2021/05/21 20:50:38\tINFO\ttorchdistill.misc.log\tEpoch: [2]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 4635.5904848249365  loss: 0.7370 (0.8017)  time: 0.0320  data: 0.0027  max mem: 281\n",
            "2021/05/21 20:50:39\tINFO\ttorchdistill.misc.log\tEpoch: [2] Total time: 0:00:11\n",
            "2021/05/21 20:50:40\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 65.6250 (65.6250)  acc5: 95.3125 (95.3125)  time: 0.5453  data: 0.4995  max mem: 281\n",
            "2021/05/21 20:50:41\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 20:50:41\tINFO\t__main__\t * Acc@1 69.4400\tAcc@5 97.3600\n",
            "\n",
            "2021/05/21 20:50:41\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 63.0400 -> 69.4400)\n",
            "2021/05/21 20:50:42\tINFO\ttorchdistill.misc.log\tEpoch: [3]  [  0/352]  eta: 0:04:02  lr: 0.1  img/s: 826.8558861036329  loss: 0.7729 (0.7729)  time: 0.6885  data: 0.5336  max mem: 281\n",
            "2021/05/21 20:50:45\tINFO\ttorchdistill.misc.log\tEpoch: [3]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 4211.313759481656  loss: 0.6764 (0.6692)  time: 0.0296  data: 0.0013  max mem: 281\n",
            "2021/05/21 20:50:48\tINFO\ttorchdistill.misc.log\tEpoch: [3]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 5185.204724789693  loss: 0.6755 (0.6690)  time: 0.0302  data: 0.0032  max mem: 281\n",
            "2021/05/21 20:50:51\tINFO\ttorchdistill.misc.log\tEpoch: [3]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 3263.097539628513  loss: 0.6784 (0.6619)  time: 0.0311  data: 0.0037  max mem: 281\n",
            "2021/05/21 20:50:53\tINFO\ttorchdistill.misc.log\tEpoch: [3] Total time: 0:00:11\n",
            "2021/05/21 20:50:53\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 64.0625 (64.0625)  acc5: 96.0938 (96.0938)  time: 0.5431  data: 0.5047  max mem: 281\n",
            "2021/05/21 20:50:54\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 20:50:54\tINFO\t__main__\t * Acc@1 69.0200\tAcc@5 98.0800\n",
            "\n",
            "2021/05/21 20:50:55\tINFO\ttorchdistill.misc.log\tEpoch: [4]  [  0/352]  eta: 0:03:46  lr: 0.1  img/s: 884.7503102314582  loss: 0.6688 (0.6688)  time: 0.6441  data: 0.4994  max mem: 281\n",
            "2021/05/21 20:50:59\tINFO\ttorchdistill.misc.log\tEpoch: [4]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 5405.956157928124  loss: 0.5398 (0.5633)  time: 0.0305  data: 0.0026  max mem: 281\n",
            "2021/05/21 20:51:02\tINFO\ttorchdistill.misc.log\tEpoch: [4]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 4770.9560379990935  loss: 0.5493 (0.5730)  time: 0.0312  data: 0.0028  max mem: 281\n",
            "2021/05/21 20:51:05\tINFO\ttorchdistill.misc.log\tEpoch: [4]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 5038.486701578542  loss: 0.5613 (0.5733)  time: 0.0297  data: 0.0033  max mem: 281\n",
            "2021/05/21 20:51:06\tINFO\ttorchdistill.misc.log\tEpoch: [4] Total time: 0:00:11\n",
            "2021/05/21 20:51:07\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 70.3125 (70.3125)  acc5: 98.4375 (98.4375)  time: 0.5657  data: 0.5292  max mem: 281\n",
            "2021/05/21 20:51:08\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 20:51:08\tINFO\t__main__\t * Acc@1 76.3200\tAcc@5 98.6400\n",
            "\n",
            "2021/05/21 20:51:08\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 69.4400 -> 76.3200)\n",
            "2021/05/21 20:51:09\tINFO\ttorchdistill.misc.log\tEpoch: [5]  [  0/352]  eta: 0:03:55  lr: 0.1  img/s: 1117.943056570692  loss: 0.5694 (0.5694)  time: 0.6688  data: 0.5543  max mem: 281\n",
            "2021/05/21 20:51:12\tINFO\ttorchdistill.misc.log\tEpoch: [5]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 3951.3281862943527  loss: 0.4905 (0.4917)  time: 0.0313  data: 0.0042  max mem: 281\n",
            "2021/05/21 20:51:15\tINFO\ttorchdistill.misc.log\tEpoch: [5]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 5300.020849786763  loss: 0.4780 (0.4959)  time: 0.0307  data: 0.0013  max mem: 281\n",
            "2021/05/21 20:51:18\tINFO\ttorchdistill.misc.log\tEpoch: [5]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 5096.166154079811  loss: 0.4670 (0.5004)  time: 0.0307  data: 0.0044  max mem: 281\n",
            "2021/05/21 20:51:20\tINFO\ttorchdistill.misc.log\tEpoch: [5] Total time: 0:00:12\n",
            "2021/05/21 20:51:21\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 71.0938 (71.0938)  acc5: 98.4375 (98.4375)  time: 0.5778  data: 0.5339  max mem: 281\n",
            "2021/05/21 20:51:22\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 20:51:22\tINFO\t__main__\t * Acc@1 76.2600\tAcc@5 98.7600\n",
            "\n",
            "2021/05/21 20:51:22\tINFO\ttorchdistill.misc.log\tEpoch: [6]  [  0/352]  eta: 0:03:33  lr: 0.1  img/s: 1009.8904880053723  loss: 0.3536 (0.3536)  time: 0.6063  data: 0.4796  max mem: 281\n",
            "2021/05/21 20:51:26\tINFO\ttorchdistill.misc.log\tEpoch: [6]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 5192.928490593413  loss: 0.4352 (0.4162)  time: 0.0298  data: 0.0025  max mem: 281\n",
            "2021/05/21 20:51:29\tINFO\ttorchdistill.misc.log\tEpoch: [6]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 3566.3718022811668  loss: 0.4661 (0.4417)  time: 0.0324  data: 0.0053  max mem: 281\n",
            "2021/05/21 20:51:32\tINFO\ttorchdistill.misc.log\tEpoch: [6]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 4419.672783252246  loss: 0.4826 (0.4527)  time: 0.0309  data: 0.0035  max mem: 281\n",
            "2021/05/21 20:51:34\tINFO\ttorchdistill.misc.log\tEpoch: [6] Total time: 0:00:12\n",
            "2021/05/21 20:51:34\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:24  acc1: 69.5312 (69.5312)  acc5: 99.2188 (99.2188)  time: 0.6061  data: 0.5744  max mem: 281\n",
            "2021/05/21 20:51:35\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 20:51:35\tINFO\t__main__\t * Acc@1 76.2000\tAcc@5 98.7600\n",
            "\n",
            "2021/05/21 20:51:36\tINFO\ttorchdistill.misc.log\tEpoch: [7]  [  0/352]  eta: 0:03:44  lr: 0.1  img/s: 1266.7875839124126  loss: 0.3875 (0.3875)  time: 0.6375  data: 0.5364  max mem: 281\n",
            "2021/05/21 20:51:40\tINFO\ttorchdistill.misc.log\tEpoch: [7]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 4424.261926541241  loss: 0.3850 (0.3897)  time: 0.0309  data: 0.0030  max mem: 281\n",
            "2021/05/21 20:51:43\tINFO\ttorchdistill.misc.log\tEpoch: [7]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 4527.843334373498  loss: 0.3914 (0.3987)  time: 0.0318  data: 0.0030  max mem: 281\n",
            "2021/05/21 20:51:46\tINFO\ttorchdistill.misc.log\tEpoch: [7]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 4089.105375000952  loss: 0.4276 (0.4060)  time: 0.0320  data: 0.0043  max mem: 281\n",
            "2021/05/21 20:51:47\tINFO\ttorchdistill.misc.log\tEpoch: [7] Total time: 0:00:12\n",
            "2021/05/21 20:51:48\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 67.9688 (67.9688)  acc5: 97.6562 (97.6562)  time: 0.5495  data: 0.5292  max mem: 281\n",
            "2021/05/21 20:51:49\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 20:51:49\tINFO\t__main__\t * Acc@1 72.1400\tAcc@5 97.3400\n",
            "\n",
            "2021/05/21 20:51:50\tINFO\ttorchdistill.misc.log\tEpoch: [8]  [  0/352]  eta: 0:03:46  lr: 0.1  img/s: 994.8852308336623  loss: 0.3999 (0.3999)  time: 0.6433  data: 0.5146  max mem: 281\n",
            "2021/05/21 20:51:53\tINFO\ttorchdistill.misc.log\tEpoch: [8]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 5316.079928705813  loss: 0.3605 (0.3470)  time: 0.0334  data: 0.0037  max mem: 281\n",
            "2021/05/21 20:51:57\tINFO\ttorchdistill.misc.log\tEpoch: [8]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 5205.465715172199  loss: 0.4055 (0.3586)  time: 0.0304  data: 0.0040  max mem: 281\n",
            "2021/05/21 20:52:00\tINFO\ttorchdistill.misc.log\tEpoch: [8]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 5161.029300930554  loss: 0.3908 (0.3680)  time: 0.0316  data: 0.0041  max mem: 281\n",
            "2021/05/21 20:52:01\tINFO\ttorchdistill.misc.log\tEpoch: [8] Total time: 0:00:12\n",
            "2021/05/21 20:52:02\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:25  acc1: 74.2188 (74.2188)  acc5: 98.4375 (98.4375)  time: 0.6407  data: 0.6189  max mem: 281\n",
            "2021/05/21 20:52:03\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 20:52:03\tINFO\t__main__\t * Acc@1 77.8400\tAcc@5 98.5800\n",
            "\n",
            "2021/05/21 20:52:03\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 76.3200 -> 77.8400)\n",
            "2021/05/21 20:52:04\tINFO\ttorchdistill.misc.log\tEpoch: [9]  [  0/352]  eta: 0:03:37  lr: 0.1  img/s: 1042.034789427306  loss: 0.2355 (0.2355)  time: 0.6190  data: 0.4961  max mem: 281\n",
            "2021/05/21 20:52:07\tINFO\ttorchdistill.misc.log\tEpoch: [9]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 3996.9543776057176  loss: 0.3210 (0.3023)  time: 0.0318  data: 0.0035  max mem: 281\n",
            "2021/05/21 20:52:10\tINFO\ttorchdistill.misc.log\tEpoch: [9]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 5233.221027595551  loss: 0.3658 (0.3209)  time: 0.0324  data: 0.0040  max mem: 281\n",
            "2021/05/21 20:52:13\tINFO\ttorchdistill.misc.log\tEpoch: [9]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 3247.3471323324825  loss: 0.3556 (0.3339)  time: 0.0320  data: 0.0039  max mem: 281\n",
            "2021/05/21 20:52:15\tINFO\ttorchdistill.misc.log\tEpoch: [9] Total time: 0:00:12\n",
            "2021/05/21 20:52:16\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 73.4375 (73.4375)  acc5: 96.0938 (96.0938)  time: 0.5416  data: 0.5099  max mem: 281\n",
            "2021/05/21 20:52:17\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 20:52:17\tINFO\t__main__\t * Acc@1 76.3200\tAcc@5 98.5200\n",
            "\n",
            "2021/05/21 20:52:18\tINFO\ttorchdistill.misc.log\tEpoch: [10]  [  0/352]  eta: 0:05:01  lr: 0.1  img/s: 1059.364133973709  loss: 0.2194 (0.2194)  time: 0.8552  data: 0.7343  max mem: 281\n",
            "2021/05/21 20:52:21\tINFO\ttorchdistill.misc.log\tEpoch: [10]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 5327.421602580005  loss: 0.2709 (0.2657)  time: 0.0310  data: 0.0039  max mem: 281\n",
            "2021/05/21 20:52:24\tINFO\ttorchdistill.misc.log\tEpoch: [10]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 4783.751933563816  loss: 0.2832 (0.2827)  time: 0.0304  data: 0.0038  max mem: 281\n",
            "2021/05/21 20:52:27\tINFO\ttorchdistill.misc.log\tEpoch: [10]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 5425.459425591689  loss: 0.3139 (0.3000)  time: 0.0308  data: 0.0041  max mem: 281\n",
            "2021/05/21 20:52:29\tINFO\ttorchdistill.misc.log\tEpoch: [10] Total time: 0:00:12\n",
            "2021/05/21 20:52:29\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 73.4375 (73.4375)  acc5: 97.6562 (97.6562)  time: 0.5473  data: 0.5117  max mem: 281\n",
            "2021/05/21 20:52:31\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 20:52:31\tINFO\t__main__\t * Acc@1 78.6000\tAcc@5 98.8600\n",
            "\n",
            "2021/05/21 20:52:31\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 77.8400 -> 78.6000)\n",
            "2021/05/21 20:52:31\tINFO\ttorchdistill.misc.log\tEpoch: [11]  [  0/352]  eta: 0:03:45  lr: 0.1  img/s: 942.53360580333  loss: 0.2597 (0.2597)  time: 0.6394  data: 0.5036  max mem: 281\n",
            "2021/05/21 20:52:35\tINFO\ttorchdistill.misc.log\tEpoch: [11]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 3793.765365970858  loss: 0.2569 (0.2511)  time: 0.0323  data: 0.0045  max mem: 281\n",
            "2021/05/21 20:52:38\tINFO\ttorchdistill.misc.log\tEpoch: [11]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 5444.883033640633  loss: 0.2494 (0.2692)  time: 0.0325  data: 0.0049  max mem: 281\n",
            "2021/05/21 20:52:41\tINFO\ttorchdistill.misc.log\tEpoch: [11]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 5329.166703063271  loss: 0.2904 (0.2728)  time: 0.0313  data: 0.0038  max mem: 281\n",
            "2021/05/21 20:52:43\tINFO\ttorchdistill.misc.log\tEpoch: [11] Total time: 0:00:12\n",
            "2021/05/21 20:52:43\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:20  acc1: 65.6250 (65.6250)  acc5: 97.6562 (97.6562)  time: 0.5175  data: 0.4875  max mem: 281\n",
            "2021/05/21 20:52:45\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 20:52:45\tINFO\t__main__\t * Acc@1 74.7600\tAcc@5 98.3000\n",
            "\n",
            "2021/05/21 20:52:45\tINFO\ttorchdistill.misc.log\tEpoch: [12]  [  0/352]  eta: 0:03:52  lr: 0.1  img/s: 944.066708986968  loss: 0.3393 (0.3393)  time: 0.6599  data: 0.5243  max mem: 281\n",
            "2021/05/21 20:52:49\tINFO\ttorchdistill.misc.log\tEpoch: [12]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 4209.0686235309795  loss: 0.2141 (0.2269)  time: 0.0331  data: 0.0045  max mem: 281\n",
            "2021/05/21 20:52:52\tINFO\ttorchdistill.misc.log\tEpoch: [12]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 4927.817305662386  loss: 0.2586 (0.2402)  time: 0.0316  data: 0.0027  max mem: 281\n",
            "2021/05/21 20:52:55\tINFO\ttorchdistill.misc.log\tEpoch: [12]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 4361.435574150047  loss: 0.2820 (0.2545)  time: 0.0319  data: 0.0036  max mem: 281\n",
            "2021/05/21 20:52:57\tINFO\ttorchdistill.misc.log\tEpoch: [12] Total time: 0:00:12\n",
            "2021/05/21 20:52:57\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 75.0000 (75.0000)  acc5: 99.2188 (99.2188)  time: 0.5424  data: 0.5036  max mem: 281\n",
            "2021/05/21 20:52:58\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 20:52:58\tINFO\t__main__\t * Acc@1 77.3600\tAcc@5 98.3600\n",
            "\n",
            "2021/05/21 20:52:59\tINFO\ttorchdistill.misc.log\tEpoch: [13]  [  0/352]  eta: 0:03:27  lr: 0.1  img/s: 1053.2188024161194  loss: 0.1873 (0.1873)  time: 0.5905  data: 0.4689  max mem: 281\n",
            "2021/05/21 20:53:03\tINFO\ttorchdistill.misc.log\tEpoch: [13]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 4726.142751505335  loss: 0.2428 (0.2125)  time: 0.0316  data: 0.0035  max mem: 281\n",
            "2021/05/21 20:53:06\tINFO\ttorchdistill.misc.log\tEpoch: [13]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 3518.59610305346  loss: 0.2470 (0.2252)  time: 0.0310  data: 0.0039  max mem: 281\n",
            "2021/05/21 20:53:09\tINFO\ttorchdistill.misc.log\tEpoch: [13]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 5279.070502861413  loss: 0.2417 (0.2416)  time: 0.0305  data: 0.0032  max mem: 281\n",
            "2021/05/21 20:53:11\tINFO\ttorchdistill.misc.log\tEpoch: [13] Total time: 0:00:12\n",
            "2021/05/21 20:53:11\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 75.7812 (75.7812)  acc5: 98.4375 (98.4375)  time: 0.5810  data: 0.5045  max mem: 281\n",
            "2021/05/21 20:53:12\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 20:53:12\tINFO\t__main__\t * Acc@1 79.0000\tAcc@5 98.8600\n",
            "\n",
            "2021/05/21 20:53:12\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 78.6000 -> 79.0000)\n",
            "2021/05/21 20:53:13\tINFO\ttorchdistill.misc.log\tEpoch: [14]  [  0/352]  eta: 0:04:40  lr: 0.1  img/s: 1191.389116473528  loss: 0.2244 (0.2244)  time: 0.7979  data: 0.6904  max mem: 281\n",
            "2021/05/21 20:53:17\tINFO\ttorchdistill.misc.log\tEpoch: [14]  [100/352]  eta: 0:00:11  lr: 0.1  img/s: 5189.916496689062  loss: 0.1567 (0.1739)  time: 0.0300  data: 0.0024  max mem: 281\n",
            "2021/05/21 20:53:20\tINFO\ttorchdistill.misc.log\tEpoch: [14]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 3646.92356601364  loss: 0.2209 (0.1979)  time: 0.0307  data: 0.0044  max mem: 281\n",
            "2021/05/21 20:53:23\tINFO\ttorchdistill.misc.log\tEpoch: [14]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 5293.540840070992  loss: 0.2300 (0.2139)  time: 0.0309  data: 0.0037  max mem: 281\n",
            "2021/05/21 20:53:25\tINFO\ttorchdistill.misc.log\tEpoch: [14] Total time: 0:00:12\n",
            "2021/05/21 20:53:25\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 72.6562 (72.6562)  acc5: 100.0000 (100.0000)  time: 0.5633  data: 0.5297  max mem: 281\n",
            "2021/05/21 20:53:26\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 20:53:26\tINFO\t__main__\t * Acc@1 77.2400\tAcc@5 98.3600\n",
            "\n",
            "2021/05/21 20:53:27\tINFO\ttorchdistill.misc.log\tEpoch: [15]  [  0/352]  eta: 0:03:21  lr: 0.1  img/s: 1226.0797851446528  loss: 0.2379 (0.2379)  time: 0.5732  data: 0.4688  max mem: 281\n",
            "2021/05/21 20:53:31\tINFO\ttorchdistill.misc.log\tEpoch: [15]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 5289.472817198369  loss: 0.1737 (0.2062)  time: 0.0314  data: 0.0044  max mem: 281\n",
            "2021/05/21 20:53:34\tINFO\ttorchdistill.misc.log\tEpoch: [15]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 5426.665911939514  loss: 0.1858 (0.2053)  time: 0.0315  data: 0.0038  max mem: 281\n",
            "2021/05/21 20:53:37\tINFO\ttorchdistill.misc.log\tEpoch: [15]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 5320.03083783382  loss: 0.2310 (0.2110)  time: 0.0307  data: 0.0025  max mem: 281\n",
            "2021/05/21 20:53:39\tINFO\ttorchdistill.misc.log\tEpoch: [15] Total time: 0:00:12\n",
            "2021/05/21 20:53:39\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:25  acc1: 75.0000 (75.0000)  acc5: 99.2188 (99.2188)  time: 0.6347  data: 0.6040  max mem: 281\n",
            "2021/05/21 20:53:40\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 20:53:40\tINFO\t__main__\t * Acc@1 80.1800\tAcc@5 99.1600\n",
            "\n",
            "2021/05/21 20:53:40\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 79.0000 -> 80.1800)\n",
            "2021/05/21 20:53:41\tINFO\ttorchdistill.misc.log\tEpoch: [16]  [  0/352]  eta: 0:03:58  lr: 0.1  img/s: 976.6296755791151  loss: 0.1541 (0.1541)  time: 0.6766  data: 0.5455  max mem: 281\n",
            "2021/05/21 20:53:44\tINFO\ttorchdistill.misc.log\tEpoch: [16]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 4307.234299284361  loss: 0.1558 (0.1549)  time: 0.0323  data: 0.0034  max mem: 281\n",
            "2021/05/21 20:53:48\tINFO\ttorchdistill.misc.log\tEpoch: [16]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 3750.9583103354316  loss: 0.2062 (0.1733)  time: 0.0305  data: 0.0034  max mem: 281\n",
            "2021/05/21 20:53:51\tINFO\ttorchdistill.misc.log\tEpoch: [16]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 5377.743729465502  loss: 0.1971 (0.1866)  time: 0.0316  data: 0.0035  max mem: 281\n",
            "2021/05/21 20:53:52\tINFO\ttorchdistill.misc.log\tEpoch: [16] Total time: 0:00:12\n",
            "2021/05/21 20:53:53\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:27  acc1: 75.7812 (75.7812)  acc5: 99.2188 (99.2188)  time: 0.6979  data: 0.6769  max mem: 281\n",
            "2021/05/21 20:53:54\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 20:53:54\tINFO\t__main__\t * Acc@1 78.1400\tAcc@5 98.6600\n",
            "\n",
            "2021/05/21 20:53:55\tINFO\ttorchdistill.misc.log\tEpoch: [17]  [  0/352]  eta: 0:03:53  lr: 0.1  img/s: 1257.3265947530879  loss: 0.2042 (0.2042)  time: 0.6647  data: 0.5629  max mem: 281\n",
            "2021/05/21 20:53:58\tINFO\ttorchdistill.misc.log\tEpoch: [17]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 4617.926611502005  loss: 0.1528 (0.1657)  time: 0.0321  data: 0.0050  max mem: 281\n",
            "2021/05/21 20:54:01\tINFO\ttorchdistill.misc.log\tEpoch: [17]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 3997.8175156935313  loss: 0.2164 (0.1771)  time: 0.0316  data: 0.0045  max mem: 281\n",
            "2021/05/21 20:54:05\tINFO\ttorchdistill.misc.log\tEpoch: [17]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 3707.928116582637  loss: 0.2103 (0.1873)  time: 0.0304  data: 0.0036  max mem: 281\n",
            "2021/05/21 20:54:06\tINFO\ttorchdistill.misc.log\tEpoch: [17] Total time: 0:00:12\n",
            "2021/05/21 20:54:07\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 72.6562 (72.6562)  acc5: 99.2188 (99.2188)  time: 0.5410  data: 0.4933  max mem: 281\n",
            "2021/05/21 20:54:08\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 20:54:08\tINFO\t__main__\t * Acc@1 78.9200\tAcc@5 99.0200\n",
            "\n",
            "2021/05/21 20:54:08\tINFO\ttorchdistill.misc.log\tEpoch: [18]  [  0/352]  eta: 0:03:40  lr: 0.1  img/s: 1030.5276764171242  loss: 0.1403 (0.1403)  time: 0.6274  data: 0.5032  max mem: 281\n",
            "2021/05/21 20:54:12\tINFO\ttorchdistill.misc.log\tEpoch: [18]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 5076.025490233156  loss: 0.1254 (0.1490)  time: 0.0311  data: 0.0045  max mem: 281\n",
            "2021/05/21 20:54:15\tINFO\ttorchdistill.misc.log\tEpoch: [18]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 5373.330183958204  loss: 0.1638 (0.1529)  time: 0.0309  data: 0.0045  max mem: 281\n",
            "2021/05/21 20:54:18\tINFO\ttorchdistill.misc.log\tEpoch: [18]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 4459.245915528053  loss: 0.2026 (0.1652)  time: 0.0306  data: 0.0033  max mem: 281\n",
            "2021/05/21 20:54:20\tINFO\ttorchdistill.misc.log\tEpoch: [18] Total time: 0:00:12\n",
            "2021/05/21 20:54:20\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 68.7500 (68.7500)  acc5: 99.2188 (99.2188)  time: 0.5482  data: 0.5112  max mem: 281\n",
            "2021/05/21 20:54:21\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 20:54:21\tINFO\t__main__\t * Acc@1 77.2600\tAcc@5 97.9000\n",
            "\n",
            "2021/05/21 20:54:22\tINFO\ttorchdistill.misc.log\tEpoch: [19]  [  0/352]  eta: 0:04:25  lr: 0.1  img/s: 1080.2296834789747  loss: 0.1177 (0.1177)  time: 0.7548  data: 0.6363  max mem: 281\n",
            "2021/05/21 20:54:26\tINFO\ttorchdistill.misc.log\tEpoch: [19]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 4627.240157208853  loss: 0.1107 (0.1328)  time: 0.0325  data: 0.0049  max mem: 281\n",
            "2021/05/21 20:54:29\tINFO\ttorchdistill.misc.log\tEpoch: [19]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 3856.526510117735  loss: 0.1629 (0.1387)  time: 0.0321  data: 0.0034  max mem: 281\n",
            "2021/05/21 20:54:32\tINFO\ttorchdistill.misc.log\tEpoch: [19]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 4537.103431956663  loss: 0.1983 (0.1588)  time: 0.0303  data: 0.0030  max mem: 281\n",
            "2021/05/21 20:54:34\tINFO\ttorchdistill.misc.log\tEpoch: [19] Total time: 0:00:12\n",
            "2021/05/21 20:54:34\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 75.0000 (75.0000)  acc5: 99.2188 (99.2188)  time: 0.5489  data: 0.5177  max mem: 281\n",
            "2021/05/21 20:54:35\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 20:54:35\tINFO\t__main__\t * Acc@1 80.8000\tAcc@5 98.7600\n",
            "\n",
            "2021/05/21 20:54:35\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 80.1800 -> 80.8000)\n",
            "2021/05/21 20:54:36\tINFO\ttorchdistill.misc.log\tEpoch: [20]  [  0/352]  eta: 0:04:27  lr: 0.1  img/s: 1078.3398651851494  loss: 0.0796 (0.0796)  time: 0.7596  data: 0.6409  max mem: 281\n",
            "2021/05/21 20:54:39\tINFO\ttorchdistill.misc.log\tEpoch: [20]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 4026.149355811198  loss: 0.1291 (0.1284)  time: 0.0308  data: 0.0034  max mem: 281\n",
            "2021/05/21 20:54:43\tINFO\ttorchdistill.misc.log\tEpoch: [20]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 5212.541380247777  loss: 0.1443 (0.1311)  time: 0.0319  data: 0.0048  max mem: 281\n",
            "2021/05/21 20:54:46\tINFO\ttorchdistill.misc.log\tEpoch: [20]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 5019.8778109192235  loss: 0.2008 (0.1459)  time: 0.0301  data: 0.0030  max mem: 281\n",
            "2021/05/21 20:54:47\tINFO\ttorchdistill.misc.log\tEpoch: [20] Total time: 0:00:12\n",
            "2021/05/21 20:54:48\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:24  acc1: 72.6562 (72.6562)  acc5: 98.4375 (98.4375)  time: 0.6149  data: 0.5412  max mem: 281\n",
            "2021/05/21 20:54:49\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 20:54:49\tINFO\t__main__\t * Acc@1 80.5600\tAcc@5 98.8800\n",
            "\n",
            "2021/05/21 20:54:50\tINFO\ttorchdistill.misc.log\tEpoch: [21]  [  0/352]  eta: 0:03:38  lr: 0.1  img/s: 1374.579556597904  loss: 0.1743 (0.1743)  time: 0.6197  data: 0.5265  max mem: 281\n",
            "2021/05/21 20:54:53\tINFO\ttorchdistill.misc.log\tEpoch: [21]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 5004.529507722998  loss: 0.1225 (0.1347)  time: 0.0305  data: 0.0026  max mem: 281\n",
            "2021/05/21 20:54:56\tINFO\ttorchdistill.misc.log\tEpoch: [21]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 4978.125401034809  loss: 0.1222 (0.1410)  time: 0.0316  data: 0.0041  max mem: 281\n",
            "2021/05/21 20:54:59\tINFO\ttorchdistill.misc.log\tEpoch: [21]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 4821.472043107319  loss: 0.1779 (0.1503)  time: 0.0304  data: 0.0033  max mem: 281\n",
            "2021/05/21 20:55:01\tINFO\ttorchdistill.misc.log\tEpoch: [21] Total time: 0:00:12\n",
            "2021/05/21 20:55:02\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:20  acc1: 69.5312 (69.5312)  acc5: 100.0000 (100.0000)  time: 0.5223  data: 0.4756  max mem: 281\n",
            "2021/05/21 20:55:03\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 20:55:03\tINFO\t__main__\t * Acc@1 77.6200\tAcc@5 98.6200\n",
            "\n",
            "2021/05/21 20:55:03\tINFO\ttorchdistill.misc.log\tEpoch: [22]  [  0/352]  eta: 0:03:54  lr: 0.1  img/s: 951.94603987432  loss: 0.1319 (0.1319)  time: 0.6664  data: 0.5319  max mem: 281\n",
            "2021/05/21 20:55:07\tINFO\ttorchdistill.misc.log\tEpoch: [22]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 5289.108043938722  loss: 0.1108 (0.1104)  time: 0.0312  data: 0.0034  max mem: 281\n",
            "2021/05/21 20:55:10\tINFO\ttorchdistill.misc.log\tEpoch: [22]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 4210.422021802212  loss: 0.1348 (0.1191)  time: 0.0312  data: 0.0029  max mem: 281\n",
            "2021/05/21 20:55:13\tINFO\ttorchdistill.misc.log\tEpoch: [22]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 4905.2601418025  loss: 0.1647 (0.1376)  time: 0.0311  data: 0.0029  max mem: 281\n",
            "2021/05/21 20:55:15\tINFO\ttorchdistill.misc.log\tEpoch: [22] Total time: 0:00:11\n",
            "2021/05/21 20:55:15\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:19  acc1: 75.0000 (75.0000)  acc5: 99.2188 (99.2188)  time: 0.4952  data: 0.4634  max mem: 281\n",
            "2021/05/21 20:55:16\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 20:55:16\tINFO\t__main__\t * Acc@1 79.5400\tAcc@5 98.8200\n",
            "\n",
            "2021/05/21 20:55:17\tINFO\ttorchdistill.misc.log\tEpoch: [23]  [  0/352]  eta: 0:03:37  lr: 0.1  img/s: 1038.3587125124266  loss: 0.1354 (0.1354)  time: 0.6191  data: 0.4958  max mem: 281\n",
            "2021/05/21 20:55:21\tINFO\ttorchdistill.misc.log\tEpoch: [23]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 4857.856889500163  loss: 0.1005 (0.1074)  time: 0.0315  data: 0.0051  max mem: 281\n",
            "2021/05/21 20:55:24\tINFO\ttorchdistill.misc.log\tEpoch: [23]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 4971.993739523426  loss: 0.1015 (0.1109)  time: 0.0315  data: 0.0039  max mem: 281\n",
            "2021/05/21 20:55:27\tINFO\ttorchdistill.misc.log\tEpoch: [23]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 5484.654720797663  loss: 0.1668 (0.1247)  time: 0.0325  data: 0.0037  max mem: 281\n",
            "2021/05/21 20:55:28\tINFO\ttorchdistill.misc.log\tEpoch: [23] Total time: 0:00:12\n",
            "2021/05/21 20:55:29\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:20  acc1: 72.6562 (72.6562)  acc5: 99.2188 (99.2188)  time: 0.5093  data: 0.4697  max mem: 281\n",
            "2021/05/21 20:55:30\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 20:55:30\tINFO\t__main__\t * Acc@1 80.6200\tAcc@5 98.6800\n",
            "\n",
            "2021/05/21 20:55:31\tINFO\ttorchdistill.misc.log\tEpoch: [24]  [  0/352]  eta: 0:03:54  lr: 0.1  img/s: 1124.1415879543451  loss: 0.1399 (0.1399)  time: 0.6653  data: 0.5514  max mem: 281\n",
            "2021/05/21 20:55:34\tINFO\ttorchdistill.misc.log\tEpoch: [24]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 4823.681362815479  loss: 0.1074 (0.1115)  time: 0.0306  data: 0.0038  max mem: 281\n",
            "2021/05/21 20:55:37\tINFO\ttorchdistill.misc.log\tEpoch: [24]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 4952.135483156846  loss: 0.1301 (0.1187)  time: 0.0307  data: 0.0042  max mem: 281\n",
            "2021/05/21 20:55:40\tINFO\ttorchdistill.misc.log\tEpoch: [24]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 5064.342156400339  loss: 0.1651 (0.1339)  time: 0.0321  data: 0.0032  max mem: 281\n",
            "2021/05/21 20:55:42\tINFO\ttorchdistill.misc.log\tEpoch: [24] Total time: 0:00:12\n",
            "2021/05/21 20:55:43\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 64.8438 (64.8438)  acc5: 100.0000 (100.0000)  time: 0.5643  data: 0.5425  max mem: 281\n",
            "2021/05/21 20:55:44\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 20:55:44\tINFO\t__main__\t * Acc@1 71.7800\tAcc@5 98.5000\n",
            "\n",
            "2021/05/21 20:55:44\tINFO\ttorchdistill.misc.log\tEpoch: [25]  [  0/352]  eta: 0:04:59  lr: 0.1  img/s: 973.159908497348  loss: 0.1621 (0.1621)  time: 0.8519  data: 0.7204  max mem: 281\n",
            "2021/05/21 20:55:48\tINFO\ttorchdistill.misc.log\tEpoch: [25]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 4990.758945088452  loss: 0.0953 (0.1240)  time: 0.0306  data: 0.0045  max mem: 281\n",
            "2021/05/21 20:55:51\tINFO\ttorchdistill.misc.log\tEpoch: [25]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 5372.308566739715  loss: 0.1008 (0.1180)  time: 0.0314  data: 0.0049  max mem: 281\n",
            "2021/05/21 20:55:54\tINFO\ttorchdistill.misc.log\tEpoch: [25]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 5305.20580649624  loss: 0.1854 (0.1315)  time: 0.0311  data: 0.0039  max mem: 281\n",
            "2021/05/21 20:55:56\tINFO\ttorchdistill.misc.log\tEpoch: [25] Total time: 0:00:12\n",
            "2021/05/21 20:55:56\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 74.2188 (74.2188)  acc5: 99.2188 (99.2188)  time: 0.5853  data: 0.5462  max mem: 281\n",
            "2021/05/21 20:55:57\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 20:55:57\tINFO\t__main__\t * Acc@1 78.3400\tAcc@5 98.3400\n",
            "\n",
            "2021/05/21 20:55:58\tINFO\ttorchdistill.misc.log\tEpoch: [26]  [  0/352]  eta: 0:03:49  lr: 0.1  img/s: 1050.1820401121247  loss: 0.0755 (0.0755)  time: 0.6507  data: 0.5288  max mem: 281\n",
            "2021/05/21 20:56:01\tINFO\ttorchdistill.misc.log\tEpoch: [26]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 5115.394770942908  loss: 0.0737 (0.0934)  time: 0.0302  data: 0.0034  max mem: 281\n",
            "2021/05/21 20:56:05\tINFO\ttorchdistill.misc.log\tEpoch: [26]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 4756.03649829025  loss: 0.1173 (0.0938)  time: 0.0315  data: 0.0038  max mem: 281\n",
            "2021/05/21 20:56:08\tINFO\ttorchdistill.misc.log\tEpoch: [26]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 3309.135978402234  loss: 0.1203 (0.1058)  time: 0.0314  data: 0.0034  max mem: 281\n",
            "2021/05/21 20:56:09\tINFO\ttorchdistill.misc.log\tEpoch: [26] Total time: 0:00:11\n",
            "2021/05/21 20:56:10\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:24  acc1: 76.5625 (76.5625)  acc5: 100.0000 (100.0000)  time: 0.6148  data: 0.5847  max mem: 281\n",
            "2021/05/21 20:56:11\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 20:56:11\tINFO\t__main__\t * Acc@1 78.6000\tAcc@5 98.8800\n",
            "\n",
            "2021/05/21 20:56:11\tINFO\ttorchdistill.misc.log\tEpoch: [27]  [  0/352]  eta: 0:03:43  lr: 0.1  img/s: 878.7635295831499  loss: 0.0589 (0.0589)  time: 0.6358  data: 0.4901  max mem: 281\n",
            "2021/05/21 20:56:15\tINFO\ttorchdistill.misc.log\tEpoch: [27]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 5190.217538839316  loss: 0.0803 (0.0916)  time: 0.0306  data: 0.0041  max mem: 281\n",
            "2021/05/21 20:56:18\tINFO\ttorchdistill.misc.log\tEpoch: [27]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 4686.659554965824  loss: 0.1220 (0.0972)  time: 0.0310  data: 0.0041  max mem: 281\n",
            "2021/05/21 20:56:21\tINFO\ttorchdistill.misc.log\tEpoch: [27]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 5869.622723197691  loss: 0.1179 (0.1090)  time: 0.0315  data: 0.0030  max mem: 281\n",
            "2021/05/21 20:56:23\tINFO\ttorchdistill.misc.log\tEpoch: [27] Total time: 0:00:12\n",
            "2021/05/21 20:56:23\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:20  acc1: 71.0938 (71.0938)  acc5: 100.0000 (100.0000)  time: 0.5148  data: 0.4878  max mem: 281\n",
            "2021/05/21 20:56:25\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 20:56:25\tINFO\t__main__\t * Acc@1 76.7600\tAcc@5 97.8000\n",
            "\n",
            "2021/05/21 20:56:25\tINFO\ttorchdistill.misc.log\tEpoch: [28]  [  0/352]  eta: 0:03:54  lr: 0.1  img/s: 976.0401999818198  loss: 0.0962 (0.0962)  time: 0.6652  data: 0.5340  max mem: 281\n",
            "2021/05/21 20:56:29\tINFO\ttorchdistill.misc.log\tEpoch: [28]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 3346.5747768413703  loss: 0.0835 (0.1056)  time: 0.0326  data: 0.0042  max mem: 281\n",
            "2021/05/21 20:56:32\tINFO\ttorchdistill.misc.log\tEpoch: [28]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 5158.103744127283  loss: 0.1058 (0.1101)  time: 0.0319  data: 0.0046  max mem: 281\n",
            "2021/05/21 20:56:35\tINFO\ttorchdistill.misc.log\tEpoch: [28]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 5318.186349678059  loss: 0.1693 (0.1222)  time: 0.0322  data: 0.0033  max mem: 281\n",
            "2021/05/21 20:56:37\tINFO\ttorchdistill.misc.log\tEpoch: [28] Total time: 0:00:12\n",
            "2021/05/21 20:56:37\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:29  acc1: 72.6562 (72.6562)  acc5: 100.0000 (100.0000)  time: 0.7395  data: 0.7139  max mem: 281\n",
            "2021/05/21 20:56:38\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 20:56:38\tINFO\t__main__\t * Acc@1 78.7600\tAcc@5 98.6000\n",
            "\n",
            "2021/05/21 20:56:39\tINFO\ttorchdistill.misc.log\tEpoch: [29]  [  0/352]  eta: 0:04:04  lr: 0.1  img/s: 810.6379336898783  loss: 0.0634 (0.0634)  time: 0.6949  data: 0.5369  max mem: 281\n",
            "2021/05/21 20:56:43\tINFO\ttorchdistill.misc.log\tEpoch: [29]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 5195.08923767684  loss: 0.0827 (0.1004)  time: 0.0309  data: 0.0040  max mem: 281\n",
            "2021/05/21 20:56:46\tINFO\ttorchdistill.misc.log\tEpoch: [29]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 5409.769268749811  loss: 0.1167 (0.1058)  time: 0.0301  data: 0.0023  max mem: 281\n",
            "2021/05/21 20:56:49\tINFO\ttorchdistill.misc.log\tEpoch: [29]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 4383.156402824836  loss: 0.1194 (0.1128)  time: 0.0308  data: 0.0029  max mem: 281\n",
            "2021/05/21 20:56:50\tINFO\ttorchdistill.misc.log\tEpoch: [29] Total time: 0:00:12\n",
            "2021/05/21 20:56:51\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 69.5312 (69.5312)  acc5: 98.4375 (98.4375)  time: 0.5616  data: 0.5178  max mem: 281\n",
            "2021/05/21 20:56:52\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 20:56:52\tINFO\t__main__\t * Acc@1 78.9400\tAcc@5 98.7200\n",
            "\n",
            "2021/05/21 20:56:53\tINFO\ttorchdistill.misc.log\tEpoch: [30]  [  0/352]  eta: 0:05:04  lr: 0.1  img/s: 1047.9230947905505  loss: 0.0506 (0.0506)  time: 0.8651  data: 0.7429  max mem: 281\n",
            "2021/05/21 20:56:56\tINFO\ttorchdistill.misc.log\tEpoch: [30]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 3316.023965114699  loss: 0.0832 (0.0855)  time: 0.0324  data: 0.0038  max mem: 281\n",
            "2021/05/21 20:56:59\tINFO\ttorchdistill.misc.log\tEpoch: [30]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 4312.077619996145  loss: 0.1037 (0.0898)  time: 0.0318  data: 0.0025  max mem: 281\n",
            "2021/05/21 20:57:03\tINFO\ttorchdistill.misc.log\tEpoch: [30]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 5104.1604822072  loss: 0.1097 (0.0987)  time: 0.0318  data: 0.0038  max mem: 281\n",
            "2021/05/21 20:57:04\tINFO\ttorchdistill.misc.log\tEpoch: [30] Total time: 0:00:12\n",
            "2021/05/21 20:57:05\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 67.9688 (67.9688)  acc5: 98.4375 (98.4375)  time: 0.5455  data: 0.5095  max mem: 281\n",
            "2021/05/21 20:57:06\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 20:57:06\tINFO\t__main__\t * Acc@1 79.1800\tAcc@5 98.9000\n",
            "\n",
            "2021/05/21 20:57:07\tINFO\ttorchdistill.misc.log\tEpoch: [31]  [  0/352]  eta: 0:03:48  lr: 0.1  img/s: 990.8164334212426  loss: 0.1008 (0.1008)  time: 0.6481  data: 0.5189  max mem: 281\n",
            "2021/05/21 20:57:10\tINFO\ttorchdistill.misc.log\tEpoch: [31]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 4058.7481534681533  loss: 0.0712 (0.0856)  time: 0.0326  data: 0.0042  max mem: 281\n",
            "2021/05/21 20:57:13\tINFO\ttorchdistill.misc.log\tEpoch: [31]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 4958.676186165939  loss: 0.0924 (0.0977)  time: 0.0315  data: 0.0025  max mem: 281\n",
            "2021/05/21 20:57:16\tINFO\ttorchdistill.misc.log\tEpoch: [31]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 5026.03411410062  loss: 0.1692 (0.1141)  time: 0.0308  data: 0.0045  max mem: 281\n",
            "2021/05/21 20:57:18\tINFO\ttorchdistill.misc.log\tEpoch: [31] Total time: 0:00:12\n",
            "2021/05/21 20:57:19\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 76.5625 (76.5625)  acc5: 99.2188 (99.2188)  time: 0.5653  data: 0.5372  max mem: 281\n",
            "2021/05/21 20:57:20\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 20:57:20\tINFO\t__main__\t * Acc@1 82.1600\tAcc@5 98.8800\n",
            "\n",
            "2021/05/21 20:57:20\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 80.8000 -> 82.1600)\n",
            "2021/05/21 20:57:20\tINFO\ttorchdistill.misc.log\tEpoch: [32]  [  0/352]  eta: 0:03:50  lr: 0.1  img/s: 963.9689013857916  loss: 0.0642 (0.0642)  time: 0.6537  data: 0.5208  max mem: 281\n",
            "2021/05/21 20:57:24\tINFO\ttorchdistill.misc.log\tEpoch: [32]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 4421.966164236884  loss: 0.0915 (0.0985)  time: 0.0310  data: 0.0039  max mem: 281\n",
            "2021/05/21 20:57:27\tINFO\ttorchdistill.misc.log\tEpoch: [32]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 4416.182678149858  loss: 0.0808 (0.0928)  time: 0.0319  data: 0.0036  max mem: 281\n",
            "2021/05/21 20:57:30\tINFO\ttorchdistill.misc.log\tEpoch: [32]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 3596.4262354383404  loss: 0.0971 (0.0982)  time: 0.0320  data: 0.0029  max mem: 281\n",
            "2021/05/21 20:57:32\tINFO\ttorchdistill.misc.log\tEpoch: [32] Total time: 0:00:12\n",
            "2021/05/21 20:57:32\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 74.2188 (74.2188)  acc5: 98.4375 (98.4375)  time: 0.5316  data: 0.4897  max mem: 281\n",
            "2021/05/21 20:57:33\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 20:57:33\tINFO\t__main__\t * Acc@1 78.7000\tAcc@5 98.8800\n",
            "\n",
            "2021/05/21 20:57:34\tINFO\ttorchdistill.misc.log\tEpoch: [33]  [  0/352]  eta: 0:03:38  lr: 0.1  img/s: 1178.133913837295  loss: 0.0993 (0.0993)  time: 0.6203  data: 0.5117  max mem: 281\n",
            "2021/05/21 20:57:38\tINFO\ttorchdistill.misc.log\tEpoch: [33]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 5284.318552713171  loss: 0.0748 (0.0835)  time: 0.0305  data: 0.0030  max mem: 281\n",
            "2021/05/21 20:57:41\tINFO\ttorchdistill.misc.log\tEpoch: [33]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 5283.278506549101  loss: 0.0886 (0.0886)  time: 0.0308  data: 0.0024  max mem: 281\n",
            "2021/05/21 20:57:44\tINFO\ttorchdistill.misc.log\tEpoch: [33]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 5315.343075521761  loss: 0.0985 (0.0969)  time: 0.0306  data: 0.0040  max mem: 281\n",
            "2021/05/21 20:57:46\tINFO\ttorchdistill.misc.log\tEpoch: [33] Total time: 0:00:12\n",
            "2021/05/21 20:57:46\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 75.0000 (75.0000)  acc5: 100.0000 (100.0000)  time: 0.5723  data: 0.5283  max mem: 281\n",
            "2021/05/21 20:57:47\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 20:57:47\tINFO\t__main__\t * Acc@1 78.5800\tAcc@5 98.5400\n",
            "\n",
            "2021/05/21 20:57:48\tINFO\ttorchdistill.misc.log\tEpoch: [34]  [  0/352]  eta: 0:04:23  lr: 0.1  img/s: 1163.5265107267396  loss: 0.1020 (0.1020)  time: 0.7481  data: 0.6380  max mem: 281\n",
            "2021/05/21 20:57:51\tINFO\ttorchdistill.misc.log\tEpoch: [34]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 4765.239224597032  loss: 0.0833 (0.0888)  time: 0.0317  data: 0.0025  max mem: 281\n",
            "2021/05/21 20:57:55\tINFO\ttorchdistill.misc.log\tEpoch: [34]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 5040.994093952169  loss: 0.1109 (0.0976)  time: 0.0293  data: 0.0024  max mem: 281\n",
            "2021/05/21 20:57:58\tINFO\ttorchdistill.misc.log\tEpoch: [34]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 3129.019524647682  loss: 0.0947 (0.1019)  time: 0.0308  data: 0.0030  max mem: 281\n",
            "2021/05/21 20:57:59\tINFO\ttorchdistill.misc.log\tEpoch: [34] Total time: 0:00:12\n",
            "2021/05/21 20:58:00\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 71.8750 (71.8750)  acc5: 98.4375 (98.4375)  time: 0.5775  data: 0.5195  max mem: 281\n",
            "2021/05/21 20:58:01\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 20:58:01\tINFO\t__main__\t * Acc@1 78.9400\tAcc@5 98.7800\n",
            "\n",
            "2021/05/21 20:58:02\tINFO\ttorchdistill.misc.log\tEpoch: [35]  [  0/352]  eta: 0:05:08  lr: 0.1  img/s: 1038.8168030804356  loss: 0.0862 (0.0862)  time: 0.8752  data: 0.7520  max mem: 281\n",
            "2021/05/21 20:58:05\tINFO\ttorchdistill.misc.log\tEpoch: [35]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 5153.05381772808  loss: 0.0736 (0.0742)  time: 0.0311  data: 0.0046  max mem: 281\n",
            "2021/05/21 20:58:08\tINFO\ttorchdistill.misc.log\tEpoch: [35]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 4099.753436373633  loss: 0.0625 (0.0823)  time: 0.0305  data: 0.0029  max mem: 281\n",
            "2021/05/21 20:58:11\tINFO\ttorchdistill.misc.log\tEpoch: [35]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 5311.294031519276  loss: 0.0893 (0.0911)  time: 0.0313  data: 0.0047  max mem: 281\n",
            "2021/05/21 20:58:13\tINFO\ttorchdistill.misc.log\tEpoch: [35] Total time: 0:00:12\n",
            "2021/05/21 20:58:14\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 74.2188 (74.2188)  acc5: 100.0000 (100.0000)  time: 0.5636  data: 0.5275  max mem: 281\n",
            "2021/05/21 20:58:15\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 20:58:15\tINFO\t__main__\t * Acc@1 76.7200\tAcc@5 98.9000\n",
            "\n",
            "2021/05/21 20:58:15\tINFO\ttorchdistill.misc.log\tEpoch: [36]  [  0/352]  eta: 0:03:35  lr: 0.1  img/s: 1207.99609388184  loss: 0.0939 (0.0939)  time: 0.6135  data: 0.5075  max mem: 281\n",
            "2021/05/21 20:58:19\tINFO\ttorchdistill.misc.log\tEpoch: [36]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 5369.836785725002  loss: 0.0710 (0.0886)  time: 0.0313  data: 0.0035  max mem: 281\n",
            "2021/05/21 20:58:22\tINFO\ttorchdistill.misc.log\tEpoch: [36]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 4232.8961074799145  loss: 0.0945 (0.0945)  time: 0.0307  data: 0.0010  max mem: 281\n",
            "2021/05/21 20:58:25\tINFO\ttorchdistill.misc.log\tEpoch: [36]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 5039.574508828417  loss: 0.1016 (0.0987)  time: 0.0322  data: 0.0044  max mem: 281\n",
            "2021/05/21 20:58:27\tINFO\ttorchdistill.misc.log\tEpoch: [36] Total time: 0:00:12\n",
            "2021/05/21 20:58:27\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 78.9062 (78.9062)  acc5: 99.2188 (99.2188)  time: 0.5556  data: 0.5278  max mem: 281\n",
            "2021/05/21 20:58:28\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 20:58:28\tINFO\t__main__\t * Acc@1 81.0600\tAcc@5 98.6600\n",
            "\n",
            "2021/05/21 20:58:29\tINFO\ttorchdistill.misc.log\tEpoch: [37]  [  0/352]  eta: 0:03:43  lr: 0.1  img/s: 959.2633373237801  loss: 0.0743 (0.0743)  time: 0.6361  data: 0.5026  max mem: 281\n",
            "2021/05/21 20:58:33\tINFO\ttorchdistill.misc.log\tEpoch: [37]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 5105.082651858051  loss: 0.0836 (0.0973)  time: 0.0305  data: 0.0037  max mem: 281\n",
            "2021/05/21 20:58:36\tINFO\ttorchdistill.misc.log\tEpoch: [37]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 5404.378014898329  loss: 0.0946 (0.0975)  time: 0.0307  data: 0.0030  max mem: 281\n",
            "2021/05/21 20:58:39\tINFO\ttorchdistill.misc.log\tEpoch: [37]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 4124.7947632474625  loss: 0.1034 (0.1029)  time: 0.0313  data: 0.0036  max mem: 281\n",
            "2021/05/21 20:58:40\tINFO\ttorchdistill.misc.log\tEpoch: [37] Total time: 0:00:12\n",
            "2021/05/21 20:58:41\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:30  acc1: 74.2188 (74.2188)  acc5: 98.4375 (98.4375)  time: 0.7519  data: 0.7222  max mem: 281\n",
            "2021/05/21 20:58:42\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 20:58:42\tINFO\t__main__\t * Acc@1 79.8800\tAcc@5 98.9600\n",
            "\n",
            "2021/05/21 20:58:43\tINFO\ttorchdistill.misc.log\tEpoch: [38]  [  0/352]  eta: 0:04:48  lr: 0.1  img/s: 1068.6911894387126  loss: 0.0697 (0.0697)  time: 0.8206  data: 0.7008  max mem: 281\n",
            "2021/05/21 20:58:46\tINFO\ttorchdistill.misc.log\tEpoch: [38]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 5173.911357394111  loss: 0.0892 (0.0930)  time: 0.0301  data: 0.0016  max mem: 281\n",
            "2021/05/21 20:58:49\tINFO\ttorchdistill.misc.log\tEpoch: [38]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 3678.3065581408096  loss: 0.0782 (0.0824)  time: 0.0310  data: 0.0016  max mem: 281\n",
            "2021/05/21 20:58:53\tINFO\ttorchdistill.misc.log\tEpoch: [38]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 4938.3333670606635  loss: 0.1189 (0.0877)  time: 0.0313  data: 0.0036  max mem: 281\n",
            "2021/05/21 20:58:54\tINFO\ttorchdistill.misc.log\tEpoch: [38] Total time: 0:00:12\n",
            "2021/05/21 20:58:55\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 73.4375 (73.4375)  acc5: 98.4375 (98.4375)  time: 0.5679  data: 0.5281  max mem: 281\n",
            "2021/05/21 20:58:56\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 20:58:56\tINFO\t__main__\t * Acc@1 80.3400\tAcc@5 98.3600\n",
            "\n",
            "2021/05/21 20:58:57\tINFO\ttorchdistill.misc.log\tEpoch: [39]  [  0/352]  eta: 0:04:12  lr: 0.1  img/s: 1446.8769104310682  loss: 0.1245 (0.1245)  time: 0.7162  data: 0.6277  max mem: 281\n",
            "2021/05/21 20:59:00\tINFO\ttorchdistill.misc.log\tEpoch: [39]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 3574.5877715708666  loss: 0.0510 (0.0705)  time: 0.0319  data: 0.0025  max mem: 281\n",
            "2021/05/21 20:59:03\tINFO\ttorchdistill.misc.log\tEpoch: [39]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 4159.436226011637  loss: 0.0692 (0.0761)  time: 0.0311  data: 0.0047  max mem: 281\n",
            "2021/05/21 20:59:06\tINFO\ttorchdistill.misc.log\tEpoch: [39]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 3304.6751283408635  loss: 0.0994 (0.0846)  time: 0.0315  data: 0.0037  max mem: 281\n",
            "2021/05/21 20:59:08\tINFO\ttorchdistill.misc.log\tEpoch: [39] Total time: 0:00:12\n",
            "2021/05/21 20:59:09\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 78.9062 (78.9062)  acc5: 99.2188 (99.2188)  time: 0.5683  data: 0.5298  max mem: 281\n",
            "2021/05/21 20:59:10\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 20:59:10\tINFO\t__main__\t * Acc@1 81.3000\tAcc@5 99.0600\n",
            "\n",
            "2021/05/21 20:59:10\tINFO\ttorchdistill.misc.log\tEpoch: [40]  [  0/352]  eta: 0:04:00  lr: 0.1  img/s: 826.8215037600933  loss: 0.0559 (0.0559)  time: 0.6846  data: 0.5298  max mem: 281\n",
            "2021/05/21 20:59:14\tINFO\ttorchdistill.misc.log\tEpoch: [40]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 3435.88587812152  loss: 0.0744 (0.0831)  time: 0.0316  data: 0.0025  max mem: 281\n",
            "2021/05/21 20:59:17\tINFO\ttorchdistill.misc.log\tEpoch: [40]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 5171.519096837583  loss: 0.0875 (0.0825)  time: 0.0321  data: 0.0038  max mem: 281\n",
            "2021/05/21 20:59:20\tINFO\ttorchdistill.misc.log\tEpoch: [40]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 3879.237203387381  loss: 0.0971 (0.0897)  time: 0.0314  data: 0.0037  max mem: 281\n",
            "2021/05/21 20:59:22\tINFO\ttorchdistill.misc.log\tEpoch: [40] Total time: 0:00:12\n",
            "2021/05/21 20:59:22\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 70.3125 (70.3125)  acc5: 99.2188 (99.2188)  time: 0.5348  data: 0.4931  max mem: 281\n",
            "2021/05/21 20:59:24\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 20:59:24\tINFO\t__main__\t * Acc@1 79.8400\tAcc@5 98.6400\n",
            "\n",
            "2021/05/21 20:59:24\tINFO\ttorchdistill.misc.log\tEpoch: [41]  [  0/352]  eta: 0:03:28  lr: 0.1  img/s: 1214.5026852166045  loss: 0.1215 (0.1215)  time: 0.5919  data: 0.4864  max mem: 281\n",
            "2021/05/21 20:59:28\tINFO\ttorchdistill.misc.log\tEpoch: [41]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 5346.947045524715  loss: 0.0908 (0.0865)  time: 0.0304  data: 0.0033  max mem: 281\n",
            "2021/05/21 20:59:31\tINFO\ttorchdistill.misc.log\tEpoch: [41]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 4113.984873447306  loss: 0.1050 (0.0948)  time: 0.0304  data: 0.0020  max mem: 281\n",
            "2021/05/21 20:59:34\tINFO\ttorchdistill.misc.log\tEpoch: [41]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 5039.3379890365695  loss: 0.1047 (0.1003)  time: 0.0310  data: 0.0035  max mem: 281\n",
            "2021/05/21 20:59:36\tINFO\ttorchdistill.misc.log\tEpoch: [41] Total time: 0:00:12\n",
            "2021/05/21 20:59:36\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:24  acc1: 75.0000 (75.0000)  acc5: 98.4375 (98.4375)  time: 0.6250  data: 0.5994  max mem: 281\n",
            "2021/05/21 20:59:37\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 20:59:37\tINFO\t__main__\t * Acc@1 79.0400\tAcc@5 98.9600\n",
            "\n",
            "2021/05/21 20:59:38\tINFO\ttorchdistill.misc.log\tEpoch: [42]  [  0/352]  eta: 0:03:36  lr: 0.1  img/s: 1061.4670193877994  loss: 0.1238 (0.1238)  time: 0.6146  data: 0.4939  max mem: 281\n",
            "2021/05/21 20:59:41\tINFO\ttorchdistill.misc.log\tEpoch: [42]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 5270.157180720526  loss: 0.0729 (0.0869)  time: 0.0311  data: 0.0034  max mem: 281\n",
            "2021/05/21 20:59:44\tINFO\ttorchdistill.misc.log\tEpoch: [42]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 4048.8002413273002  loss: 0.0625 (0.0832)  time: 0.0304  data: 0.0030  max mem: 281\n",
            "2021/05/21 20:59:48\tINFO\ttorchdistill.misc.log\tEpoch: [42]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 4299.060001121067  loss: 0.0831 (0.0852)  time: 0.0310  data: 0.0042  max mem: 281\n",
            "2021/05/21 20:59:49\tINFO\ttorchdistill.misc.log\tEpoch: [42] Total time: 0:00:12\n",
            "2021/05/21 20:59:50\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 72.6562 (72.6562)  acc5: 99.2188 (99.2188)  time: 0.5500  data: 0.5001  max mem: 281\n",
            "2021/05/21 20:59:51\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 20:59:51\tINFO\t__main__\t * Acc@1 79.1200\tAcc@5 98.4000\n",
            "\n",
            "2021/05/21 20:59:52\tINFO\ttorchdistill.misc.log\tEpoch: [43]  [  0/352]  eta: 0:03:40  lr: 0.1  img/s: 1039.7261434895945  loss: 0.2047 (0.2047)  time: 0.6251  data: 0.5020  max mem: 281\n",
            "2021/05/21 20:59:55\tINFO\ttorchdistill.misc.log\tEpoch: [43]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 4171.102243769034  loss: 0.0901 (0.0816)  time: 0.0315  data: 0.0032  max mem: 281\n",
            "2021/05/21 20:59:58\tINFO\ttorchdistill.misc.log\tEpoch: [43]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 5233.935286375822  loss: 0.0971 (0.0893)  time: 0.0316  data: 0.0043  max mem: 281\n",
            "2021/05/21 21:00:01\tINFO\ttorchdistill.misc.log\tEpoch: [43]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 5412.823632605737  loss: 0.1192 (0.0967)  time: 0.0314  data: 0.0037  max mem: 281\n",
            "2021/05/21 21:00:03\tINFO\ttorchdistill.misc.log\tEpoch: [43] Total time: 0:00:12\n",
            "2021/05/21 21:00:04\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 80.4688 (80.4688)  acc5: 99.2188 (99.2188)  time: 0.5735  data: 0.5151  max mem: 281\n",
            "2021/05/21 21:00:05\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:00:05\tINFO\t__main__\t * Acc@1 81.4000\tAcc@5 98.7200\n",
            "\n",
            "2021/05/21 21:00:05\tINFO\ttorchdistill.misc.log\tEpoch: [44]  [  0/352]  eta: 0:03:43  lr: 0.1  img/s: 984.7427442593303  loss: 0.0568 (0.0568)  time: 0.6353  data: 0.5053  max mem: 281\n",
            "2021/05/21 21:00:09\tINFO\ttorchdistill.misc.log\tEpoch: [44]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 5271.036807948711  loss: 0.0552 (0.0672)  time: 0.0314  data: 0.0026  max mem: 281\n",
            "2021/05/21 21:00:12\tINFO\ttorchdistill.misc.log\tEpoch: [44]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 5278.395768402631  loss: 0.0806 (0.0731)  time: 0.0313  data: 0.0038  max mem: 281\n",
            "2021/05/21 21:00:15\tINFO\ttorchdistill.misc.log\tEpoch: [44]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 5131.284582373574  loss: 0.0892 (0.0775)  time: 0.0303  data: 0.0029  max mem: 281\n",
            "2021/05/21 21:00:17\tINFO\ttorchdistill.misc.log\tEpoch: [44] Total time: 0:00:12\n",
            "2021/05/21 21:00:17\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 65.6250 (65.6250)  acc5: 99.2188 (99.2188)  time: 0.5682  data: 0.5291  max mem: 281\n",
            "2021/05/21 21:00:18\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:00:18\tINFO\t__main__\t * Acc@1 77.2600\tAcc@5 98.5600\n",
            "\n",
            "2021/05/21 21:00:19\tINFO\ttorchdistill.misc.log\tEpoch: [45]  [  0/352]  eta: 0:03:47  lr: 0.1  img/s: 980.1099593622095  loss: 0.0796 (0.0796)  time: 0.6469  data: 0.5163  max mem: 281\n",
            "2021/05/21 21:00:23\tINFO\ttorchdistill.misc.log\tEpoch: [45]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 5319.240186267711  loss: 0.0991 (0.0847)  time: 0.0299  data: 0.0027  max mem: 281\n",
            "2021/05/21 21:00:26\tINFO\ttorchdistill.misc.log\tEpoch: [45]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 5494.084119609489  loss: 0.0795 (0.0824)  time: 0.0306  data: 0.0030  max mem: 281\n",
            "2021/05/21 21:00:29\tINFO\ttorchdistill.misc.log\tEpoch: [45]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 4099.816051928216  loss: 0.1026 (0.0916)  time: 0.0306  data: 0.0030  max mem: 281\n",
            "2021/05/21 21:00:30\tINFO\ttorchdistill.misc.log\tEpoch: [45] Total time: 0:00:12\n",
            "2021/05/21 21:00:31\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:29  acc1: 67.9688 (67.9688)  acc5: 99.2188 (99.2188)  time: 0.7292  data: 0.7067  max mem: 281\n",
            "2021/05/21 21:00:32\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:00:32\tINFO\t__main__\t * Acc@1 75.2000\tAcc@5 98.6600\n",
            "\n",
            "2021/05/21 21:00:33\tINFO\ttorchdistill.misc.log\tEpoch: [46]  [  0/352]  eta: 0:04:03  lr: 0.1  img/s: 1049.071850366775  loss: 0.1114 (0.1114)  time: 0.6924  data: 0.5703  max mem: 281\n",
            "2021/05/21 21:00:36\tINFO\ttorchdistill.misc.log\tEpoch: [46]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 4231.294772266927  loss: 0.0962 (0.0986)  time: 0.0320  data: 0.0050  max mem: 281\n",
            "2021/05/21 21:00:39\tINFO\ttorchdistill.misc.log\tEpoch: [46]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 3735.507768523737  loss: 0.0686 (0.0888)  time: 0.0311  data: 0.0031  max mem: 281\n",
            "2021/05/21 21:00:43\tINFO\ttorchdistill.misc.log\tEpoch: [46]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 4715.515862698942  loss: 0.1019 (0.0909)  time: 0.0325  data: 0.0047  max mem: 281\n",
            "2021/05/21 21:00:44\tINFO\ttorchdistill.misc.log\tEpoch: [46] Total time: 0:00:12\n",
            "2021/05/21 21:00:45\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 74.2188 (74.2188)  acc5: 97.6562 (97.6562)  time: 0.5521  data: 0.5135  max mem: 281\n",
            "2021/05/21 21:00:46\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:00:46\tINFO\t__main__\t * Acc@1 80.7400\tAcc@5 98.9000\n",
            "\n",
            "2021/05/21 21:00:46\tINFO\ttorchdistill.misc.log\tEpoch: [47]  [  0/352]  eta: 0:03:41  lr: 0.1  img/s: 926.868403106878  loss: 0.0148 (0.0148)  time: 0.6298  data: 0.4916  max mem: 281\n",
            "2021/05/21 21:00:50\tINFO\ttorchdistill.misc.log\tEpoch: [47]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 5290.77598967213  loss: 0.0523 (0.0692)  time: 0.0316  data: 0.0033  max mem: 281\n",
            "2021/05/21 21:00:53\tINFO\ttorchdistill.misc.log\tEpoch: [47]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 4872.892325845246  loss: 0.0812 (0.0770)  time: 0.0316  data: 0.0043  max mem: 281\n",
            "2021/05/21 21:00:56\tINFO\ttorchdistill.misc.log\tEpoch: [47]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 3723.202529889872  loss: 0.1094 (0.0874)  time: 0.0321  data: 0.0040  max mem: 281\n",
            "2021/05/21 21:00:58\tINFO\ttorchdistill.misc.log\tEpoch: [47] Total time: 0:00:12\n",
            "2021/05/21 21:00:59\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:24  acc1: 68.7500 (68.7500)  acc5: 100.0000 (100.0000)  time: 0.6067  data: 0.5436  max mem: 281\n",
            "2021/05/21 21:01:00\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:01:00\tINFO\t__main__\t * Acc@1 76.8400\tAcc@5 98.1800\n",
            "\n",
            "2021/05/21 21:01:00\tINFO\ttorchdistill.misc.log\tEpoch: [48]  [  0/352]  eta: 0:03:43  lr: 0.1  img/s: 986.6755960530838  loss: 0.0646 (0.0646)  time: 0.6339  data: 0.5041  max mem: 281\n",
            "2021/05/21 21:01:04\tINFO\ttorchdistill.misc.log\tEpoch: [48]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 4578.348771564773  loss: 0.0764 (0.0836)  time: 0.0321  data: 0.0041  max mem: 281\n",
            "2021/05/21 21:01:07\tINFO\ttorchdistill.misc.log\tEpoch: [48]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 3579.4019028062057  loss: 0.0786 (0.0840)  time: 0.0312  data: 0.0043  max mem: 281\n",
            "2021/05/21 21:01:10\tINFO\ttorchdistill.misc.log\tEpoch: [48]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 3678.1301562724802  loss: 0.1051 (0.0878)  time: 0.0315  data: 0.0032  max mem: 281\n",
            "2021/05/21 21:01:12\tINFO\ttorchdistill.misc.log\tEpoch: [48] Total time: 0:00:12\n",
            "2021/05/21 21:01:12\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 68.7500 (68.7500)  acc5: 99.2188 (99.2188)  time: 0.5323  data: 0.5090  max mem: 281\n",
            "2021/05/21 21:01:13\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:01:13\tINFO\t__main__\t * Acc@1 75.8200\tAcc@5 98.3400\n",
            "\n",
            "2021/05/21 21:01:14\tINFO\ttorchdistill.misc.log\tEpoch: [49]  [  0/352]  eta: 0:03:37  lr: 0.1  img/s: 965.3850726730334  loss: 0.0421 (0.0421)  time: 0.6167  data: 0.4841  max mem: 281\n",
            "2021/05/21 21:01:17\tINFO\ttorchdistill.misc.log\tEpoch: [49]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 5261.995844278042  loss: 0.0823 (0.0919)  time: 0.0306  data: 0.0026  max mem: 281\n",
            "2021/05/21 21:01:20\tINFO\ttorchdistill.misc.log\tEpoch: [49]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 5090.657412148452  loss: 0.0778 (0.0878)  time: 0.0312  data: 0.0026  max mem: 281\n",
            "2021/05/21 21:01:24\tINFO\ttorchdistill.misc.log\tEpoch: [49]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 3518.7344715713584  loss: 0.0879 (0.0931)  time: 0.0306  data: 0.0027  max mem: 281\n",
            "2021/05/21 21:01:25\tINFO\ttorchdistill.misc.log\tEpoch: [49] Total time: 0:00:11\n",
            "2021/05/21 21:01:26\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:26  acc1: 77.3438 (77.3438)  acc5: 98.4375 (98.4375)  time: 0.6540  data: 0.6360  max mem: 281\n",
            "2021/05/21 21:01:27\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:01:27\tINFO\t__main__\t * Acc@1 79.1000\tAcc@5 98.4200\n",
            "\n",
            "2021/05/21 21:01:27\tINFO\ttorchdistill.misc.log\tEpoch: [50]  [  0/352]  eta: 0:03:49  lr: 0.1  img/s: 944.3423668412156  loss: 0.0515 (0.0515)  time: 0.6507  data: 0.5151  max mem: 281\n",
            "2021/05/21 21:01:31\tINFO\ttorchdistill.misc.log\tEpoch: [50]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 5014.860558959796  loss: 0.0463 (0.0698)  time: 0.0316  data: 0.0041  max mem: 281\n",
            "2021/05/21 21:01:34\tINFO\ttorchdistill.misc.log\tEpoch: [50]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 3532.208141164396  loss: 0.0710 (0.0688)  time: 0.0316  data: 0.0030  max mem: 281\n",
            "2021/05/21 21:01:37\tINFO\ttorchdistill.misc.log\tEpoch: [50]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 5464.7799515482175  loss: 0.1035 (0.0794)  time: 0.0316  data: 0.0039  max mem: 281\n",
            "2021/05/21 21:01:39\tINFO\ttorchdistill.misc.log\tEpoch: [50] Total time: 0:00:12\n",
            "2021/05/21 21:01:40\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:26  acc1: 74.2188 (74.2188)  acc5: 98.4375 (98.4375)  time: 0.6653  data: 0.6231  max mem: 281\n",
            "2021/05/21 21:01:41\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:01:41\tINFO\t__main__\t * Acc@1 76.6600\tAcc@5 97.4400\n",
            "\n",
            "2021/05/21 21:01:41\tINFO\ttorchdistill.misc.log\tEpoch: [51]  [  0/352]  eta: 0:03:40  lr: 0.1  img/s: 1151.426250252002  loss: 0.0597 (0.0597)  time: 0.6251  data: 0.5139  max mem: 281\n",
            "2021/05/21 21:01:45\tINFO\ttorchdistill.misc.log\tEpoch: [51]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 5215.225046870598  loss: 0.0796 (0.0819)  time: 0.0305  data: 0.0037  max mem: 281\n",
            "2021/05/21 21:01:48\tINFO\ttorchdistill.misc.log\tEpoch: [51]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 5316.816986214546  loss: 0.0780 (0.0826)  time: 0.0304  data: 0.0042  max mem: 281\n",
            "2021/05/21 21:01:51\tINFO\ttorchdistill.misc.log\tEpoch: [51]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 5269.433002237839  loss: 0.1034 (0.0868)  time: 0.0304  data: 0.0039  max mem: 281\n",
            "2021/05/21 21:01:53\tINFO\ttorchdistill.misc.log\tEpoch: [51] Total time: 0:00:11\n",
            "2021/05/21 21:01:53\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 75.7812 (75.7812)  acc5: 100.0000 (100.0000)  time: 0.5605  data: 0.5213  max mem: 281\n",
            "2021/05/21 21:01:54\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:01:54\tINFO\t__main__\t * Acc@1 81.0000\tAcc@5 98.6800\n",
            "\n",
            "2021/05/21 21:01:55\tINFO\ttorchdistill.misc.log\tEpoch: [52]  [  0/352]  eta: 0:03:49  lr: 0.1  img/s: 950.6918734372675  loss: 0.0507 (0.0507)  time: 0.6524  data: 0.5178  max mem: 281\n",
            "2021/05/21 21:01:58\tINFO\ttorchdistill.misc.log\tEpoch: [52]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 3677.248400663023  loss: 0.0824 (0.0768)  time: 0.0323  data: 0.0037  max mem: 281\n",
            "2021/05/21 21:02:02\tINFO\ttorchdistill.misc.log\tEpoch: [52]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 4026.149355811198  loss: 0.0829 (0.0808)  time: 0.0319  data: 0.0041  max mem: 281\n",
            "2021/05/21 21:02:05\tINFO\ttorchdistill.misc.log\tEpoch: [52]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 4897.697546913344  loss: 0.1007 (0.0874)  time: 0.0306  data: 0.0040  max mem: 281\n",
            "2021/05/21 21:02:06\tINFO\ttorchdistill.misc.log\tEpoch: [52] Total time: 0:00:12\n",
            "2021/05/21 21:02:07\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 75.0000 (75.0000)  acc5: 100.0000 (100.0000)  time: 0.5310  data: 0.4828  max mem: 281\n",
            "2021/05/21 21:02:08\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:02:08\tINFO\t__main__\t * Acc@1 80.3400\tAcc@5 99.0200\n",
            "\n",
            "2021/05/21 21:02:09\tINFO\ttorchdistill.misc.log\tEpoch: [53]  [  0/352]  eta: 0:04:03  lr: 0.1  img/s: 832.6019748422406  loss: 0.1589 (0.1589)  time: 0.6920  data: 0.5382  max mem: 281\n",
            "2021/05/21 21:02:12\tINFO\ttorchdistill.misc.log\tEpoch: [53]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 5156.865101625235  loss: 0.0903 (0.0813)  time: 0.0318  data: 0.0036  max mem: 281\n",
            "2021/05/21 21:02:15\tINFO\ttorchdistill.misc.log\tEpoch: [53]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 3908.722930863766  loss: 0.0736 (0.0894)  time: 0.0321  data: 0.0042  max mem: 281\n",
            "2021/05/21 21:02:18\tINFO\ttorchdistill.misc.log\tEpoch: [53]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 4092.440595795283  loss: 0.0973 (0.0956)  time: 0.0312  data: 0.0026  max mem: 281\n",
            "2021/05/21 21:02:20\tINFO\ttorchdistill.misc.log\tEpoch: [53] Total time: 0:00:12\n",
            "2021/05/21 21:02:21\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:27  acc1: 76.5625 (76.5625)  acc5: 100.0000 (100.0000)  time: 0.6971  data: 0.6674  max mem: 281\n",
            "2021/05/21 21:02:22\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:02:22\tINFO\t__main__\t * Acc@1 79.4000\tAcc@5 98.7400\n",
            "\n",
            "2021/05/21 21:02:22\tINFO\ttorchdistill.misc.log\tEpoch: [54]  [  0/352]  eta: 0:03:32  lr: 0.1  img/s: 1248.2031828696977  loss: 0.0287 (0.0287)  time: 0.6040  data: 0.5014  max mem: 281\n",
            "2021/05/21 21:02:26\tINFO\ttorchdistill.misc.log\tEpoch: [54]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 4546.401483651884  loss: 0.0457 (0.0690)  time: 0.0333  data: 0.0039  max mem: 281\n",
            "2021/05/21 21:02:29\tINFO\ttorchdistill.misc.log\tEpoch: [54]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 5100.765887908183  loss: 0.0585 (0.0670)  time: 0.0308  data: 0.0034  max mem: 281\n",
            "2021/05/21 21:02:32\tINFO\ttorchdistill.misc.log\tEpoch: [54]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 4502.137662686167  loss: 0.0895 (0.0732)  time: 0.0314  data: 0.0046  max mem: 281\n",
            "2021/05/21 21:02:34\tINFO\ttorchdistill.misc.log\tEpoch: [54] Total time: 0:00:12\n",
            "2021/05/21 21:02:35\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:26  acc1: 74.2188 (74.2188)  acc5: 100.0000 (100.0000)  time: 0.6528  data: 0.6209  max mem: 281\n",
            "2021/05/21 21:02:36\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:02:36\tINFO\t__main__\t * Acc@1 77.7600\tAcc@5 98.5600\n",
            "\n",
            "2021/05/21 21:02:36\tINFO\ttorchdistill.misc.log\tEpoch: [55]  [  0/352]  eta: 0:04:06  lr: 0.1  img/s: 1166.228401122629  loss: 0.0184 (0.0184)  time: 0.7014  data: 0.5917  max mem: 281\n",
            "2021/05/21 21:02:40\tINFO\ttorchdistill.misc.log\tEpoch: [55]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 5165.200230902444  loss: 0.0555 (0.0670)  time: 0.0317  data: 0.0044  max mem: 281\n",
            "2021/05/21 21:02:43\tINFO\ttorchdistill.misc.log\tEpoch: [55]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 5107.073732675057  loss: 0.0735 (0.0741)  time: 0.0304  data: 0.0032  max mem: 281\n",
            "2021/05/21 21:02:46\tINFO\ttorchdistill.misc.log\tEpoch: [55]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 5202.03589008178  loss: 0.0970 (0.0834)  time: 0.0328  data: 0.0038  max mem: 281\n",
            "2021/05/21 21:02:48\tINFO\ttorchdistill.misc.log\tEpoch: [55] Total time: 0:00:12\n",
            "2021/05/21 21:02:48\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 78.1250 (78.1250)  acc5: 100.0000 (100.0000)  time: 0.5615  data: 0.5186  max mem: 281\n",
            "2021/05/21 21:02:49\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:02:49\tINFO\t__main__\t * Acc@1 81.6200\tAcc@5 98.7400\n",
            "\n",
            "2021/05/21 21:02:50\tINFO\ttorchdistill.misc.log\tEpoch: [56]  [  0/352]  eta: 0:03:48  lr: 0.1  img/s: 978.2490634247314  loss: 0.0726 (0.0726)  time: 0.6496  data: 0.5187  max mem: 281\n",
            "2021/05/21 21:02:54\tINFO\ttorchdistill.misc.log\tEpoch: [56]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 3910.8299363335714  loss: 0.0670 (0.0821)  time: 0.0312  data: 0.0040  max mem: 281\n",
            "2021/05/21 21:02:57\tINFO\ttorchdistill.misc.log\tEpoch: [56]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 3707.697649845648  loss: 0.0561 (0.0798)  time: 0.0311  data: 0.0037  max mem: 281\n",
            "2021/05/21 21:03:00\tINFO\ttorchdistill.misc.log\tEpoch: [56]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 5243.801762028482  loss: 0.1162 (0.0880)  time: 0.0307  data: 0.0026  max mem: 281\n",
            "2021/05/21 21:03:02\tINFO\ttorchdistill.misc.log\tEpoch: [56] Total time: 0:00:12\n",
            "2021/05/21 21:03:02\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 70.3125 (70.3125)  acc5: 99.2188 (99.2188)  time: 0.5579  data: 0.5165  max mem: 281\n",
            "2021/05/21 21:03:03\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:03:03\tINFO\t__main__\t * Acc@1 80.1200\tAcc@5 98.5000\n",
            "\n",
            "2021/05/21 21:03:04\tINFO\ttorchdistill.misc.log\tEpoch: [57]  [  0/352]  eta: 0:04:22  lr: 0.1  img/s: 1071.750511549541  loss: 0.0253 (0.0253)  time: 0.7448  data: 0.6253  max mem: 281\n",
            "2021/05/21 21:03:08\tINFO\ttorchdistill.misc.log\tEpoch: [57]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 5403.181417443288  loss: 0.0579 (0.0769)  time: 0.0310  data: 0.0025  max mem: 281\n",
            "2021/05/21 21:03:11\tINFO\ttorchdistill.misc.log\tEpoch: [57]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 5123.742968667983  loss: 0.0674 (0.0731)  time: 0.0309  data: 0.0040  max mem: 281\n",
            "2021/05/21 21:03:14\tINFO\ttorchdistill.misc.log\tEpoch: [57]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 3786.567585676703  loss: 0.0920 (0.0765)  time: 0.0306  data: 0.0025  max mem: 281\n",
            "2021/05/21 21:03:15\tINFO\ttorchdistill.misc.log\tEpoch: [57] Total time: 0:00:12\n",
            "2021/05/21 21:03:16\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 76.5625 (76.5625)  acc5: 99.2188 (99.2188)  time: 0.5822  data: 0.5502  max mem: 281\n",
            "2021/05/21 21:03:17\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:03:17\tINFO\t__main__\t * Acc@1 80.5000\tAcc@5 98.6200\n",
            "\n",
            "2021/05/21 21:03:18\tINFO\ttorchdistill.misc.log\tEpoch: [58]  [  0/352]  eta: 0:03:58  lr: 0.1  img/s: 1121.7387830491052  loss: 0.0637 (0.0637)  time: 0.6779  data: 0.5638  max mem: 281\n",
            "2021/05/21 21:03:21\tINFO\ttorchdistill.misc.log\tEpoch: [58]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 5019.267702548569  loss: 0.0762 (0.0771)  time: 0.0315  data: 0.0047  max mem: 281\n",
            "2021/05/21 21:03:24\tINFO\ttorchdistill.misc.log\tEpoch: [58]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 4802.366087322104  loss: 0.0916 (0.0778)  time: 0.0315  data: 0.0040  max mem: 281\n",
            "2021/05/21 21:03:28\tINFO\ttorchdistill.misc.log\tEpoch: [58]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 5192.024525400617  loss: 0.0929 (0.0860)  time: 0.0304  data: 0.0037  max mem: 281\n",
            "2021/05/21 21:03:29\tINFO\ttorchdistill.misc.log\tEpoch: [58] Total time: 0:00:12\n",
            "2021/05/21 21:03:30\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:20  acc1: 75.0000 (75.0000)  acc5: 100.0000 (100.0000)  time: 0.5244  data: 0.4961  max mem: 281\n",
            "2021/05/21 21:03:31\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:03:31\tINFO\t__main__\t * Acc@1 80.7200\tAcc@5 98.6200\n",
            "\n",
            "2021/05/21 21:03:31\tINFO\ttorchdistill.misc.log\tEpoch: [59]  [  0/352]  eta: 0:03:41  lr: 0.1  img/s: 926.5117023957035  loss: 0.0950 (0.0950)  time: 0.6285  data: 0.4903  max mem: 281\n",
            "2021/05/21 21:03:35\tINFO\ttorchdistill.misc.log\tEpoch: [59]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 4243.569186018939  loss: 0.0855 (0.0874)  time: 0.0309  data: 0.0038  max mem: 281\n",
            "2021/05/21 21:03:38\tINFO\ttorchdistill.misc.log\tEpoch: [59]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 5349.770930904598  loss: 0.0886 (0.0847)  time: 0.0316  data: 0.0035  max mem: 281\n",
            "2021/05/21 21:03:41\tINFO\ttorchdistill.misc.log\tEpoch: [59]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 5013.362020020917  loss: 0.1107 (0.0882)  time: 0.0306  data: 0.0041  max mem: 281\n",
            "2021/05/21 21:03:43\tINFO\ttorchdistill.misc.log\tEpoch: [59] Total time: 0:00:12\n",
            "2021/05/21 21:03:44\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:29  acc1: 71.8750 (71.8750)  acc5: 98.4375 (98.4375)  time: 0.7260  data: 0.6939  max mem: 281\n",
            "2021/05/21 21:03:45\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:03:45\tINFO\t__main__\t * Acc@1 78.7000\tAcc@5 98.2800\n",
            "\n",
            "2021/05/21 21:03:45\tINFO\ttorchdistill.misc.log\tEpoch: [60]  [  0/352]  eta: 0:03:31  lr: 0.1  img/s: 1189.4226966287156  loss: 0.0895 (0.0895)  time: 0.6018  data: 0.4942  max mem: 281\n",
            "2021/05/21 21:03:49\tINFO\ttorchdistill.misc.log\tEpoch: [60]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 3651.8849617718283  loss: 0.0545 (0.0765)  time: 0.0310  data: 0.0026  max mem: 281\n",
            "2021/05/21 21:03:52\tINFO\ttorchdistill.misc.log\tEpoch: [60]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 4328.277721343459  loss: 0.0713 (0.0742)  time: 0.0313  data: 0.0026  max mem: 281\n",
            "2021/05/21 21:03:55\tINFO\ttorchdistill.misc.log\tEpoch: [60]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 4013.53801069039  loss: 0.0668 (0.0709)  time: 0.0319  data: 0.0050  max mem: 281\n",
            "2021/05/21 21:03:57\tINFO\ttorchdistill.misc.log\tEpoch: [60] Total time: 0:00:12\n",
            "2021/05/21 21:03:57\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 76.5625 (76.5625)  acc5: 99.2188 (99.2188)  time: 0.5475  data: 0.5121  max mem: 281\n",
            "2021/05/21 21:03:58\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:03:58\tINFO\t__main__\t * Acc@1 80.2800\tAcc@5 98.8800\n",
            "\n",
            "2021/05/21 21:03:59\tINFO\ttorchdistill.misc.log\tEpoch: [61]  [  0/352]  eta: 0:04:50  lr: 0.1  img/s: 984.7933216059109  loss: 0.0298 (0.0298)  time: 0.8249  data: 0.6949  max mem: 281\n",
            "2021/05/21 21:04:02\tINFO\ttorchdistill.misc.log\tEpoch: [61]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 4817.059469547428  loss: 0.0620 (0.0624)  time: 0.0313  data: 0.0034  max mem: 281\n",
            "2021/05/21 21:04:06\tINFO\ttorchdistill.misc.log\tEpoch: [61]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 4252.409184877743  loss: 0.0608 (0.0667)  time: 0.0312  data: 0.0029  max mem: 281\n",
            "2021/05/21 21:04:09\tINFO\ttorchdistill.misc.log\tEpoch: [61]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 5348.864831475227  loss: 0.0898 (0.0749)  time: 0.0309  data: 0.0024  max mem: 281\n",
            "2021/05/21 21:04:10\tINFO\ttorchdistill.misc.log\tEpoch: [61] Total time: 0:00:12\n",
            "2021/05/21 21:04:11\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 73.4375 (73.4375)  acc5: 100.0000 (100.0000)  time: 0.5852  data: 0.5528  max mem: 281\n",
            "2021/05/21 21:04:12\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:04:12\tINFO\t__main__\t * Acc@1 79.0600\tAcc@5 98.6400\n",
            "\n",
            "2021/05/21 21:04:13\tINFO\ttorchdistill.misc.log\tEpoch: [62]  [  0/352]  eta: 0:04:23  lr: 0.1  img/s: 1045.3887892577513  loss: 0.0926 (0.0926)  time: 0.7500  data: 0.6275  max mem: 281\n",
            "2021/05/21 21:04:16\tINFO\ttorchdistill.misc.log\tEpoch: [62]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 3481.991840970263  loss: 0.0881 (0.0828)  time: 0.0322  data: 0.0041  max mem: 281\n",
            "2021/05/21 21:04:19\tINFO\ttorchdistill.misc.log\tEpoch: [62]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 5435.2914401417365  loss: 0.0953 (0.0878)  time: 0.0311  data: 0.0047  max mem: 281\n",
            "2021/05/21 21:04:22\tINFO\ttorchdistill.misc.log\tEpoch: [62]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 5211.074127638923  loss: 0.1124 (0.0919)  time: 0.0311  data: 0.0036  max mem: 281\n",
            "2021/05/21 21:04:24\tINFO\ttorchdistill.misc.log\tEpoch: [62] Total time: 0:00:12\n",
            "2021/05/21 21:04:25\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 72.6562 (72.6562)  acc5: 96.8750 (96.8750)  time: 0.5766  data: 0.5430  max mem: 281\n",
            "2021/05/21 21:04:26\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:04:26\tINFO\t__main__\t * Acc@1 76.2000\tAcc@5 98.3400\n",
            "\n",
            "2021/05/21 21:04:26\tINFO\ttorchdistill.misc.log\tEpoch: [63]  [  0/352]  eta: 0:03:37  lr: 0.1  img/s: 1022.8158241172044  loss: 0.1093 (0.1093)  time: 0.6172  data: 0.4920  max mem: 281\n",
            "2021/05/21 21:04:30\tINFO\ttorchdistill.misc.log\tEpoch: [63]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 5283.590477408942  loss: 0.0768 (0.0889)  time: 0.0317  data: 0.0045  max mem: 281\n",
            "2021/05/21 21:04:33\tINFO\ttorchdistill.misc.log\tEpoch: [63]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 3829.349082375766  loss: 0.1094 (0.0925)  time: 0.0315  data: 0.0028  max mem: 281\n",
            "2021/05/21 21:04:36\tINFO\ttorchdistill.misc.log\tEpoch: [63]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 5131.284582373574  loss: 0.1037 (0.0961)  time: 0.0309  data: 0.0033  max mem: 281\n",
            "2021/05/21 21:04:38\tINFO\ttorchdistill.misc.log\tEpoch: [63] Total time: 0:00:12\n",
            "2021/05/21 21:04:39\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:24  acc1: 77.3438 (77.3438)  acc5: 97.6562 (97.6562)  time: 0.6019  data: 0.5262  max mem: 281\n",
            "2021/05/21 21:04:40\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:04:40\tINFO\t__main__\t * Acc@1 80.6200\tAcc@5 98.7600\n",
            "\n",
            "2021/05/21 21:04:40\tINFO\ttorchdistill.misc.log\tEpoch: [64]  [  0/352]  eta: 0:03:57  lr: 0.1  img/s: 782.949632712705  loss: 0.0392 (0.0392)  time: 0.6739  data: 0.5104  max mem: 281\n",
            "2021/05/21 21:04:44\tINFO\ttorchdistill.misc.log\tEpoch: [64]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 5333.3490160237625  loss: 0.0530 (0.0644)  time: 0.0325  data: 0.0058  max mem: 281\n",
            "2021/05/21 21:04:47\tINFO\ttorchdistill.misc.log\tEpoch: [64]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 4626.28319316145  loss: 0.0693 (0.0694)  time: 0.0315  data: 0.0032  max mem: 281\n",
            "2021/05/21 21:04:50\tINFO\ttorchdistill.misc.log\tEpoch: [64]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 5454.009833800642  loss: 0.0909 (0.0782)  time: 0.0322  data: 0.0054  max mem: 281\n",
            "2021/05/21 21:04:52\tINFO\ttorchdistill.misc.log\tEpoch: [64] Total time: 0:00:12\n",
            "2021/05/21 21:04:52\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 75.0000 (75.0000)  acc5: 97.6562 (97.6562)  time: 0.5832  data: 0.5471  max mem: 281\n",
            "2021/05/21 21:04:53\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:04:53\tINFO\t__main__\t * Acc@1 80.7400\tAcc@5 98.2600\n",
            "\n",
            "2021/05/21 21:04:54\tINFO\ttorchdistill.misc.log\tEpoch: [65]  [  0/352]  eta: 0:04:06  lr: 0.1  img/s: 915.3699989940444  loss: 0.0781 (0.0781)  time: 0.7000  data: 0.5602  max mem: 281\n",
            "2021/05/21 21:04:58\tINFO\ttorchdistill.misc.log\tEpoch: [65]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 4499.534115004568  loss: 0.0883 (0.0730)  time: 0.0307  data: 0.0031  max mem: 281\n",
            "2021/05/21 21:05:01\tINFO\ttorchdistill.misc.log\tEpoch: [65]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 4375.618699876117  loss: 0.0842 (0.0713)  time: 0.0312  data: 0.0025  max mem: 281\n",
            "2021/05/21 21:05:04\tINFO\ttorchdistill.misc.log\tEpoch: [65]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 4882.5976936229035  loss: 0.0650 (0.0764)  time: 0.0294  data: 0.0015  max mem: 281\n",
            "2021/05/21 21:05:06\tINFO\ttorchdistill.misc.log\tEpoch: [65] Total time: 0:00:12\n",
            "2021/05/21 21:05:06\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 74.2188 (74.2188)  acc5: 97.6562 (97.6562)  time: 0.5717  data: 0.5141  max mem: 281\n",
            "2021/05/21 21:05:07\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:05:07\tINFO\t__main__\t * Acc@1 78.6000\tAcc@5 98.4000\n",
            "\n",
            "2021/05/21 21:05:08\tINFO\ttorchdistill.misc.log\tEpoch: [66]  [  0/352]  eta: 0:03:33  lr: 0.1  img/s: 1241.7104846842012  loss: 0.0573 (0.0573)  time: 0.6069  data: 0.5038  max mem: 281\n",
            "2021/05/21 21:05:11\tINFO\ttorchdistill.misc.log\tEpoch: [66]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 5412.332520112103  loss: 0.0701 (0.0736)  time: 0.0318  data: 0.0041  max mem: 281\n",
            "2021/05/21 21:05:15\tINFO\ttorchdistill.misc.log\tEpoch: [66]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 4784.9030935553155  loss: 0.0726 (0.0750)  time: 0.0309  data: 0.0029  max mem: 281\n",
            "2021/05/21 21:05:18\tINFO\ttorchdistill.misc.log\tEpoch: [66]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 4668.970509709793  loss: 0.0827 (0.0806)  time: 0.0308  data: 0.0032  max mem: 281\n",
            "2021/05/21 21:05:19\tINFO\ttorchdistill.misc.log\tEpoch: [66] Total time: 0:00:12\n",
            "2021/05/21 21:05:20\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 76.5625 (76.5625)  acc5: 99.2188 (99.2188)  time: 0.5348  data: 0.5026  max mem: 281\n",
            "2021/05/21 21:05:21\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:05:21\tINFO\t__main__\t * Acc@1 80.3000\tAcc@5 98.9800\n",
            "\n",
            "2021/05/21 21:05:22\tINFO\ttorchdistill.misc.log\tEpoch: [67]  [  0/352]  eta: 0:03:49  lr: 0.1  img/s: 1086.5940585242245  loss: 0.0155 (0.0155)  time: 0.6533  data: 0.5355  max mem: 281\n",
            "2021/05/21 21:05:25\tINFO\ttorchdistill.misc.log\tEpoch: [67]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 5260.964565694575  loss: 0.0432 (0.0539)  time: 0.0317  data: 0.0037  max mem: 281\n",
            "2021/05/21 21:05:28\tINFO\ttorchdistill.misc.log\tEpoch: [67]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 5306.7790089653745  loss: 0.0936 (0.0681)  time: 0.0318  data: 0.0037  max mem: 281\n",
            "2021/05/21 21:05:32\tINFO\ttorchdistill.misc.log\tEpoch: [67]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 5529.051616889804  loss: 0.1023 (0.0790)  time: 0.0306  data: 0.0036  max mem: 281\n",
            "2021/05/21 21:05:33\tINFO\ttorchdistill.misc.log\tEpoch: [67] Total time: 0:00:12\n",
            "2021/05/21 21:05:34\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:26  acc1: 78.1250 (78.1250)  acc5: 99.2188 (99.2188)  time: 0.6653  data: 0.6400  max mem: 281\n",
            "2021/05/21 21:05:35\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:05:35\tINFO\t__main__\t * Acc@1 80.7800\tAcc@5 98.4800\n",
            "\n",
            "2021/05/21 21:05:35\tINFO\ttorchdistill.misc.log\tEpoch: [68]  [  0/352]  eta: 0:03:41  lr: 0.1  img/s: 1129.0874317284658  loss: 0.1000 (0.1000)  time: 0.6288  data: 0.5154  max mem: 281\n",
            "2021/05/21 21:05:39\tINFO\ttorchdistill.misc.log\tEpoch: [68]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 4377.188402961224  loss: 0.0636 (0.0793)  time: 0.0319  data: 0.0034  max mem: 281\n",
            "2021/05/21 21:05:42\tINFO\ttorchdistill.misc.log\tEpoch: [68]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 5165.647516140516  loss: 0.0844 (0.0827)  time: 0.0307  data: 0.0026  max mem: 281\n",
            "2021/05/21 21:05:45\tINFO\ttorchdistill.misc.log\tEpoch: [68]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 3778.1204222378606  loss: 0.1051 (0.0902)  time: 0.0311  data: 0.0024  max mem: 281\n",
            "2021/05/21 21:05:47\tINFO\ttorchdistill.misc.log\tEpoch: [68] Total time: 0:00:12\n",
            "2021/05/21 21:05:48\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:27  acc1: 76.5625 (76.5625)  acc5: 98.4375 (98.4375)  time: 0.6786  data: 0.6406  max mem: 281\n",
            "2021/05/21 21:05:49\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:05:49\tINFO\t__main__\t * Acc@1 80.4600\tAcc@5 98.6400\n",
            "\n",
            "2021/05/21 21:05:49\tINFO\ttorchdistill.misc.log\tEpoch: [69]  [  0/352]  eta: 0:03:59  lr: 0.1  img/s: 1015.3702207495498  loss: 0.0542 (0.0542)  time: 0.6797  data: 0.5536  max mem: 281\n",
            "2021/05/21 21:05:53\tINFO\ttorchdistill.misc.log\tEpoch: [69]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 5258.233631404198  loss: 0.0450 (0.0687)  time: 0.0303  data: 0.0031  max mem: 281\n",
            "2021/05/21 21:05:56\tINFO\ttorchdistill.misc.log\tEpoch: [69]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 3457.949799364924  loss: 0.0487 (0.0663)  time: 0.0311  data: 0.0027  max mem: 281\n",
            "2021/05/21 21:05:59\tINFO\ttorchdistill.misc.log\tEpoch: [69]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 3972.2902170856946  loss: 0.0741 (0.0698)  time: 0.0324  data: 0.0037  max mem: 281\n",
            "2021/05/21 21:06:01\tINFO\ttorchdistill.misc.log\tEpoch: [69] Total time: 0:00:12\n",
            "2021/05/21 21:06:01\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 74.2188 (74.2188)  acc5: 98.4375 (98.4375)  time: 0.5668  data: 0.5454  max mem: 281\n",
            "2021/05/21 21:06:02\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:06:02\tINFO\t__main__\t * Acc@1 79.0800\tAcc@5 98.8800\n",
            "\n",
            "2021/05/21 21:06:03\tINFO\ttorchdistill.misc.log\tEpoch: [70]  [  0/352]  eta: 0:03:54  lr: 0.1  img/s: 977.8214509478224  loss: 0.0729 (0.0729)  time: 0.6670  data: 0.5360  max mem: 281\n",
            "2021/05/21 21:06:07\tINFO\ttorchdistill.misc.log\tEpoch: [70]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 4497.687046562673  loss: 0.0724 (0.0812)  time: 0.0311  data: 0.0037  max mem: 281\n",
            "2021/05/21 21:06:10\tINFO\ttorchdistill.misc.log\tEpoch: [70]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 4724.2712753319665  loss: 0.0696 (0.0799)  time: 0.0329  data: 0.0049  max mem: 281\n",
            "2021/05/21 21:06:13\tINFO\ttorchdistill.misc.log\tEpoch: [70]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 4079.62820103649  loss: 0.0750 (0.0795)  time: 0.0306  data: 0.0030  max mem: 281\n",
            "2021/05/21 21:06:14\tINFO\ttorchdistill.misc.log\tEpoch: [70] Total time: 0:00:12\n",
            "2021/05/21 21:06:15\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 75.0000 (75.0000)  acc5: 99.2188 (99.2188)  time: 0.5533  data: 0.4922  max mem: 281\n",
            "2021/05/21 21:06:16\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:06:16\tINFO\t__main__\t * Acc@1 78.4600\tAcc@5 98.9400\n",
            "\n",
            "2021/05/21 21:06:17\tINFO\ttorchdistill.misc.log\tEpoch: [71]  [  0/352]  eta: 0:04:26  lr: 0.1  img/s: 1103.9594007164096  loss: 0.0369 (0.0369)  time: 0.7573  data: 0.6413  max mem: 281\n",
            "2021/05/21 21:06:20\tINFO\ttorchdistill.misc.log\tEpoch: [71]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 5068.023297744801  loss: 0.0667 (0.0671)  time: 0.0318  data: 0.0041  max mem: 281\n",
            "2021/05/21 21:06:23\tINFO\ttorchdistill.misc.log\tEpoch: [71]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 5380.276714937115  loss: 0.0969 (0.0722)  time: 0.0305  data: 0.0027  max mem: 281\n",
            "2021/05/21 21:06:27\tINFO\ttorchdistill.misc.log\tEpoch: [71]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 5155.429021385291  loss: 0.0944 (0.0785)  time: 0.0316  data: 0.0039  max mem: 281\n",
            "2021/05/21 21:06:28\tINFO\ttorchdistill.misc.log\tEpoch: [71] Total time: 0:00:12\n",
            "2021/05/21 21:06:29\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:26  acc1: 75.7812 (75.7812)  acc5: 98.4375 (98.4375)  time: 0.6727  data: 0.6587  max mem: 281\n",
            "2021/05/21 21:06:30\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:06:30\tINFO\t__main__\t * Acc@1 78.4600\tAcc@5 98.6400\n",
            "\n",
            "2021/05/21 21:06:31\tINFO\ttorchdistill.misc.log\tEpoch: [72]  [  0/352]  eta: 0:03:55  lr: 0.1  img/s: 942.9391859968842  loss: 0.3152 (0.3152)  time: 0.6699  data: 0.5201  max mem: 281\n",
            "2021/05/21 21:06:34\tINFO\ttorchdistill.misc.log\tEpoch: [72]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 5438.154351063075  loss: 0.0865 (0.0901)  time: 0.0310  data: 0.0035  max mem: 281\n",
            "2021/05/21 21:06:37\tINFO\ttorchdistill.misc.log\tEpoch: [72]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 4776.176645374802  loss: 0.0744 (0.0825)  time: 0.0312  data: 0.0021  max mem: 281\n",
            "2021/05/21 21:06:40\tINFO\ttorchdistill.misc.log\tEpoch: [72]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 5304.838860124106  loss: 0.0739 (0.0838)  time: 0.0324  data: 0.0038  max mem: 281\n",
            "2021/05/21 21:06:42\tINFO\ttorchdistill.misc.log\tEpoch: [72] Total time: 0:00:12\n",
            "2021/05/21 21:06:43\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 75.0000 (75.0000)  acc5: 98.4375 (98.4375)  time: 0.5966  data: 0.5779  max mem: 281\n",
            "2021/05/21 21:06:44\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:06:44\tINFO\t__main__\t * Acc@1 79.6400\tAcc@5 98.8600\n",
            "\n",
            "2021/05/21 21:06:44\tINFO\ttorchdistill.misc.log\tEpoch: [73]  [  0/352]  eta: 0:03:41  lr: 0.1  img/s: 1066.4706272633186  loss: 0.0291 (0.0291)  time: 0.6279  data: 0.5079  max mem: 281\n",
            "2021/05/21 21:06:48\tINFO\ttorchdistill.misc.log\tEpoch: [73]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 5188.963426892446  loss: 0.0673 (0.0761)  time: 0.0312  data: 0.0037  max mem: 281\n",
            "2021/05/21 21:06:51\tINFO\ttorchdistill.misc.log\tEpoch: [73]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 5170.62256936753  loss: 0.0653 (0.0707)  time: 0.0314  data: 0.0046  max mem: 281\n",
            "2021/05/21 21:06:54\tINFO\ttorchdistill.misc.log\tEpoch: [73]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 4555.157916171729  loss: 0.0882 (0.0771)  time: 0.0314  data: 0.0047  max mem: 281\n",
            "2021/05/21 21:06:56\tINFO\ttorchdistill.misc.log\tEpoch: [73] Total time: 0:00:12\n",
            "2021/05/21 21:06:56\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 71.0938 (71.0938)  acc5: 99.2188 (99.2188)  time: 0.5794  data: 0.5534  max mem: 281\n",
            "2021/05/21 21:06:57\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:06:57\tINFO\t__main__\t * Acc@1 79.6600\tAcc@5 98.9400\n",
            "\n",
            "2021/05/21 21:06:58\tINFO\ttorchdistill.misc.log\tEpoch: [74]  [  0/352]  eta: 0:04:17  lr: 0.1  img/s: 994.7193309135646  loss: 0.0986 (0.0986)  time: 0.7324  data: 0.6037  max mem: 281\n",
            "2021/05/21 21:07:02\tINFO\ttorchdistill.misc.log\tEpoch: [74]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 3813.1119634080515  loss: 0.0724 (0.0714)  time: 0.0312  data: 0.0032  max mem: 281\n",
            "2021/05/21 21:07:05\tINFO\ttorchdistill.misc.log\tEpoch: [74]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 3936.5809649508724  loss: 0.0805 (0.0737)  time: 0.0306  data: 0.0031  max mem: 281\n",
            "2021/05/21 21:07:08\tINFO\ttorchdistill.misc.log\tEpoch: [74]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 5293.540840070992  loss: 0.0839 (0.0818)  time: 0.0317  data: 0.0042  max mem: 281\n",
            "2021/05/21 21:07:09\tINFO\ttorchdistill.misc.log\tEpoch: [74] Total time: 0:00:12\n",
            "2021/05/21 21:07:10\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 75.0000 (75.0000)  acc5: 100.0000 (100.0000)  time: 0.5917  data: 0.5734  max mem: 281\n",
            "2021/05/21 21:07:11\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:07:11\tINFO\t__main__\t * Acc@1 78.3000\tAcc@5 98.3600\n",
            "\n",
            "2021/05/21 21:07:12\tINFO\ttorchdistill.misc.log\tEpoch: [75]  [  0/352]  eta: 0:03:40  lr: 0.1  img/s: 978.2579759950291  loss: 0.0490 (0.0490)  time: 0.6272  data: 0.4964  max mem: 281\n",
            "2021/05/21 21:07:15\tINFO\ttorchdistill.misc.log\tEpoch: [75]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 5018.282456091155  loss: 0.0475 (0.0646)  time: 0.0311  data: 0.0035  max mem: 281\n",
            "2021/05/21 21:07:18\tINFO\ttorchdistill.misc.log\tEpoch: [75]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 4939.832833403875  loss: 0.0564 (0.0625)  time: 0.0317  data: 0.0035  max mem: 281\n",
            "2021/05/21 21:07:21\tINFO\ttorchdistill.misc.log\tEpoch: [75]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 5106.68510715203  loss: 0.0852 (0.0722)  time: 0.0320  data: 0.0046  max mem: 281\n",
            "2021/05/21 21:07:23\tINFO\ttorchdistill.misc.log\tEpoch: [75] Total time: 0:00:12\n",
            "2021/05/21 21:07:24\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 82.0312 (82.0312)  acc5: 99.2188 (99.2188)  time: 0.5965  data: 0.5604  max mem: 281\n",
            "2021/05/21 21:07:25\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:07:25\tINFO\t__main__\t * Acc@1 81.6000\tAcc@5 98.9400\n",
            "\n",
            "2021/05/21 21:07:25\tINFO\ttorchdistill.misc.log\tEpoch: [76]  [  0/352]  eta: 0:03:37  lr: 0.1  img/s: 1005.2651710766039  loss: 0.0260 (0.0260)  time: 0.6189  data: 0.4916  max mem: 281\n",
            "2021/05/21 21:07:29\tINFO\ttorchdistill.misc.log\tEpoch: [76]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 3908.409921157808  loss: 0.0606 (0.0569)  time: 0.0316  data: 0.0017  max mem: 281\n",
            "2021/05/21 21:07:32\tINFO\ttorchdistill.misc.log\tEpoch: [76]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 5299.654620297523  loss: 0.0713 (0.0656)  time: 0.0322  data: 0.0025  max mem: 281\n",
            "2021/05/21 21:07:35\tINFO\ttorchdistill.misc.log\tEpoch: [76]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 5076.2654664763  loss: 0.0909 (0.0743)  time: 0.0310  data: 0.0042  max mem: 281\n",
            "2021/05/21 21:07:37\tINFO\ttorchdistill.misc.log\tEpoch: [76] Total time: 0:00:12\n",
            "2021/05/21 21:07:38\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:27  acc1: 75.7812 (75.7812)  acc5: 99.2188 (99.2188)  time: 0.6889  data: 0.6727  max mem: 281\n",
            "2021/05/21 21:07:39\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:07:39\tINFO\t__main__\t * Acc@1 79.4600\tAcc@5 98.9600\n",
            "\n",
            "2021/05/21 21:07:39\tINFO\ttorchdistill.misc.log\tEpoch: [77]  [  0/352]  eta: 0:03:41  lr: 0.1  img/s: 1117.7731436756721  loss: 0.0359 (0.0359)  time: 0.6292  data: 0.5147  max mem: 281\n",
            "2021/05/21 21:07:43\tINFO\ttorchdistill.misc.log\tEpoch: [77]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 3782.565802174265  loss: 0.0744 (0.1007)  time: 0.0298  data: 0.0022  max mem: 281\n",
            "2021/05/21 21:07:46\tINFO\ttorchdistill.misc.log\tEpoch: [77]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 5181.701512416875  loss: 0.0907 (0.0896)  time: 0.0302  data: 0.0034  max mem: 281\n",
            "2021/05/21 21:07:49\tINFO\ttorchdistill.misc.log\tEpoch: [77]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 4621.345177839755  loss: 0.1188 (0.0957)  time: 0.0314  data: 0.0038  max mem: 281\n",
            "2021/05/21 21:07:51\tINFO\ttorchdistill.misc.log\tEpoch: [77] Total time: 0:00:12\n",
            "2021/05/21 21:07:51\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 75.7812 (75.7812)  acc5: 99.2188 (99.2188)  time: 0.5486  data: 0.5153  max mem: 281\n",
            "2021/05/21 21:07:52\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:07:52\tINFO\t__main__\t * Acc@1 80.0600\tAcc@5 99.0200\n",
            "\n",
            "2021/05/21 21:07:53\tINFO\ttorchdistill.misc.log\tEpoch: [78]  [  0/352]  eta: 0:03:49  lr: 0.1  img/s: 947.7448346961545  loss: 0.0350 (0.0350)  time: 0.6518  data: 0.5167  max mem: 281\n",
            "2021/05/21 21:07:56\tINFO\ttorchdistill.misc.log\tEpoch: [78]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 5291.088846620083  loss: 0.0545 (0.0643)  time: 0.0305  data: 0.0029  max mem: 281\n",
            "2021/05/21 21:08:00\tINFO\ttorchdistill.misc.log\tEpoch: [78]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 4149.887238154131  loss: 0.0627 (0.0722)  time: 0.0309  data: 0.0023  max mem: 281\n",
            "2021/05/21 21:08:03\tINFO\ttorchdistill.misc.log\tEpoch: [78]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 5294.89823855455  loss: 0.0755 (0.0736)  time: 0.0313  data: 0.0044  max mem: 281\n",
            "2021/05/21 21:08:04\tINFO\ttorchdistill.misc.log\tEpoch: [78] Total time: 0:00:12\n",
            "2021/05/21 21:08:05\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:24  acc1: 74.2188 (74.2188)  acc5: 96.8750 (96.8750)  time: 0.6149  data: 0.5964  max mem: 281\n",
            "2021/05/21 21:08:06\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:08:06\tINFO\t__main__\t * Acc@1 79.5800\tAcc@5 97.9800\n",
            "\n",
            "2021/05/21 21:08:07\tINFO\ttorchdistill.misc.log\tEpoch: [79]  [  0/352]  eta: 0:03:47  lr: 0.1  img/s: 1129.7408168075149  loss: 0.0435 (0.0435)  time: 0.6454  data: 0.5320  max mem: 281\n",
            "2021/05/21 21:08:10\tINFO\ttorchdistill.misc.log\tEpoch: [79]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 4799.6183698829755  loss: 0.0568 (0.0711)  time: 0.0315  data: 0.0026  max mem: 281\n",
            "2021/05/21 21:08:13\tINFO\ttorchdistill.misc.log\tEpoch: [79]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 4593.665822438223  loss: 0.0601 (0.0710)  time: 0.0310  data: 0.0047  max mem: 281\n",
            "2021/05/21 21:08:16\tINFO\ttorchdistill.misc.log\tEpoch: [79]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 3533.4867643380853  loss: 0.0672 (0.0728)  time: 0.0311  data: 0.0026  max mem: 281\n",
            "2021/05/21 21:08:18\tINFO\ttorchdistill.misc.log\tEpoch: [79] Total time: 0:00:12\n",
            "2021/05/21 21:08:19\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 75.7812 (75.7812)  acc5: 99.2188 (99.2188)  time: 0.5506  data: 0.5373  max mem: 281\n",
            "2021/05/21 21:08:20\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:08:20\tINFO\t__main__\t * Acc@1 81.0000\tAcc@5 98.9400\n",
            "\n",
            "2021/05/21 21:08:20\tINFO\ttorchdistill.misc.log\tEpoch: [80]  [  0/352]  eta: 0:03:31  lr: 0.1  img/s: 1299.5236645212512  loss: 0.0569 (0.0569)  time: 0.6017  data: 0.5032  max mem: 281\n",
            "2021/05/21 21:08:24\tINFO\ttorchdistill.misc.log\tEpoch: [80]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 5194.93842953215  loss: 0.0677 (0.0781)  time: 0.0320  data: 0.0043  max mem: 281\n",
            "2021/05/21 21:08:27\tINFO\ttorchdistill.misc.log\tEpoch: [80]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 5308.248173306044  loss: 0.0755 (0.0863)  time: 0.0321  data: 0.0046  max mem: 281\n",
            "2021/05/21 21:08:30\tINFO\ttorchdistill.misc.log\tEpoch: [80]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 5293.123319004614  loss: 0.1009 (0.0948)  time: 0.0314  data: 0.0040  max mem: 281\n",
            "2021/05/21 21:08:32\tINFO\ttorchdistill.misc.log\tEpoch: [80] Total time: 0:00:12\n",
            "2021/05/21 21:08:33\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:30  acc1: 68.7500 (68.7500)  acc5: 99.2188 (99.2188)  time: 0.7577  data: 0.7275  max mem: 281\n",
            "2021/05/21 21:08:33\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:08:33\tINFO\t__main__\t * Acc@1 78.3400\tAcc@5 98.7400\n",
            "\n",
            "2021/05/21 21:08:34\tINFO\ttorchdistill.misc.log\tEpoch: [81]  [  0/352]  eta: 0:03:33  lr: 0.1  img/s: 1144.2164005421948  loss: 0.0723 (0.0723)  time: 0.6059  data: 0.4940  max mem: 281\n",
            "2021/05/21 21:08:38\tINFO\ttorchdistill.misc.log\tEpoch: [81]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 4564.840676813196  loss: 0.0443 (0.0594)  time: 0.0310  data: 0.0043  max mem: 281\n",
            "2021/05/21 21:08:41\tINFO\ttorchdistill.misc.log\tEpoch: [81]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 5053.188057678552  loss: 0.0562 (0.0589)  time: 0.0310  data: 0.0031  max mem: 281\n",
            "2021/05/21 21:08:44\tINFO\ttorchdistill.misc.log\tEpoch: [81]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 3379.7988756476357  loss: 0.0651 (0.0631)  time: 0.0314  data: 0.0027  max mem: 281\n",
            "2021/05/21 21:08:46\tINFO\ttorchdistill.misc.log\tEpoch: [81] Total time: 0:00:12\n",
            "2021/05/21 21:08:46\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:25  acc1: 71.0938 (71.0938)  acc5: 96.0938 (96.0938)  time: 0.6333  data: 0.6056  max mem: 281\n",
            "2021/05/21 21:08:47\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:08:47\tINFO\t__main__\t * Acc@1 74.4600\tAcc@5 98.2200\n",
            "\n",
            "2021/05/21 21:08:48\tINFO\ttorchdistill.misc.log\tEpoch: [82]  [  0/352]  eta: 0:03:34  lr: 0.1  img/s: 1171.4833672643324  loss: 0.0812 (0.0812)  time: 0.6105  data: 0.5012  max mem: 281\n",
            "2021/05/21 21:08:51\tINFO\ttorchdistill.misc.log\tEpoch: [82]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 3612.8108100833097  loss: 0.0604 (0.0654)  time: 0.0315  data: 0.0032  max mem: 281\n",
            "2021/05/21 21:08:55\tINFO\ttorchdistill.misc.log\tEpoch: [82]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 5174.210545591226  loss: 0.0715 (0.0669)  time: 0.0314  data: 0.0052  max mem: 281\n",
            "2021/05/21 21:08:58\tINFO\ttorchdistill.misc.log\tEpoch: [82]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 4570.592293677955  loss: 0.0816 (0.0722)  time: 0.0312  data: 0.0041  max mem: 281\n",
            "2021/05/21 21:08:59\tINFO\ttorchdistill.misc.log\tEpoch: [82] Total time: 0:00:12\n",
            "2021/05/21 21:09:00\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:20  acc1: 75.0000 (75.0000)  acc5: 100.0000 (100.0000)  time: 0.5046  data: 0.4668  max mem: 281\n",
            "2021/05/21 21:09:01\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:09:01\tINFO\t__main__\t * Acc@1 81.1800\tAcc@5 98.7200\n",
            "\n",
            "2021/05/21 21:09:02\tINFO\ttorchdistill.misc.log\tEpoch: [83]  [  0/352]  eta: 0:03:40  lr: 0.1  img/s: 916.4278237714012  loss: 0.0667 (0.0667)  time: 0.6268  data: 0.4871  max mem: 281\n",
            "2021/05/21 21:09:05\tINFO\ttorchdistill.misc.log\tEpoch: [83]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 5466.56055391508  loss: 0.0598 (0.0611)  time: 0.0309  data: 0.0034  max mem: 281\n",
            "2021/05/21 21:09:08\tINFO\ttorchdistill.misc.log\tEpoch: [83]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 5090.271280932967  loss: 0.0677 (0.0622)  time: 0.0312  data: 0.0026  max mem: 281\n",
            "2021/05/21 21:09:11\tINFO\ttorchdistill.misc.log\tEpoch: [83]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 5312.607979734009  loss: 0.0850 (0.0697)  time: 0.0316  data: 0.0043  max mem: 281\n",
            "2021/05/21 21:09:13\tINFO\ttorchdistill.misc.log\tEpoch: [83] Total time: 0:00:12\n",
            "2021/05/21 21:09:14\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:25  acc1: 70.3125 (70.3125)  acc5: 96.0938 (96.0938)  time: 0.6490  data: 0.6213  max mem: 281\n",
            "2021/05/21 21:09:15\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:09:15\tINFO\t__main__\t * Acc@1 79.0400\tAcc@5 98.0800\n",
            "\n",
            "2021/05/21 21:09:15\tINFO\ttorchdistill.misc.log\tEpoch: [84]  [  0/352]  eta: 0:03:50  lr: 0.1  img/s: 876.2735740808748  loss: 0.0410 (0.0410)  time: 0.6554  data: 0.5093  max mem: 281\n",
            "2021/05/21 21:09:19\tINFO\ttorchdistill.misc.log\tEpoch: [84]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 3707.5696251484765  loss: 0.0608 (0.0700)  time: 0.0308  data: 0.0030  max mem: 281\n",
            "2021/05/21 21:09:22\tINFO\ttorchdistill.misc.log\tEpoch: [84]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 4617.4897178095625  loss: 0.0846 (0.0792)  time: 0.0307  data: 0.0040  max mem: 281\n",
            "2021/05/21 21:09:25\tINFO\ttorchdistill.misc.log\tEpoch: [84]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 3763.34248342189  loss: 0.1016 (0.0856)  time: 0.0306  data: 0.0042  max mem: 281\n",
            "2021/05/21 21:09:27\tINFO\ttorchdistill.misc.log\tEpoch: [84] Total time: 0:00:11\n",
            "2021/05/21 21:09:27\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 71.8750 (71.8750)  acc5: 99.2188 (99.2188)  time: 0.5831  data: 0.5390  max mem: 281\n",
            "2021/05/21 21:09:28\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:09:28\tINFO\t__main__\t * Acc@1 80.0800\tAcc@5 98.5200\n",
            "\n",
            "2021/05/21 21:09:29\tINFO\ttorchdistill.misc.log\tEpoch: [85]  [  0/352]  eta: 0:03:49  lr: 0.1  img/s: 978.5022436236253  loss: 0.0458 (0.0458)  time: 0.6515  data: 0.5206  max mem: 281\n",
            "2021/05/21 21:09:32\tINFO\ttorchdistill.misc.log\tEpoch: [85]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 5386.214316528718  loss: 0.0637 (0.0775)  time: 0.0301  data: 0.0018  max mem: 281\n",
            "2021/05/21 21:09:35\tINFO\ttorchdistill.misc.log\tEpoch: [85]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 5131.08841547916  loss: 0.0629 (0.0782)  time: 0.0300  data: 0.0029  max mem: 281\n",
            "2021/05/21 21:09:39\tINFO\ttorchdistill.misc.log\tEpoch: [85]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 5073.387248277752  loss: 0.0838 (0.0813)  time: 0.0300  data: 0.0029  max mem: 281\n",
            "2021/05/21 21:09:40\tINFO\ttorchdistill.misc.log\tEpoch: [85] Total time: 0:00:11\n",
            "2021/05/21 21:09:41\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 77.3438 (77.3438)  acc5: 100.0000 (100.0000)  time: 0.5648  data: 0.5070  max mem: 281\n",
            "2021/05/21 21:09:42\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:09:42\tINFO\t__main__\t * Acc@1 79.3000\tAcc@5 98.0600\n",
            "\n",
            "2021/05/21 21:09:42\tINFO\ttorchdistill.misc.log\tEpoch: [86]  [  0/352]  eta: 0:03:31  lr: 0.1  img/s: 982.8480374926772  loss: 0.0443 (0.0443)  time: 0.6001  data: 0.4699  max mem: 281\n",
            "2021/05/21 21:09:46\tINFO\ttorchdistill.misc.log\tEpoch: [86]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 5584.842525746385  loss: 0.0479 (0.0657)  time: 0.0308  data: 0.0040  max mem: 281\n",
            "2021/05/21 21:09:49\tINFO\ttorchdistill.misc.log\tEpoch: [86]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 5268.140321267013  loss: 0.0729 (0.0675)  time: 0.0309  data: 0.0032  max mem: 281\n",
            "2021/05/21 21:09:52\tINFO\ttorchdistill.misc.log\tEpoch: [86]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 4375.547376485354  loss: 0.0928 (0.0711)  time: 0.0314  data: 0.0034  max mem: 281\n",
            "2021/05/21 21:09:54\tINFO\ttorchdistill.misc.log\tEpoch: [86] Total time: 0:00:12\n",
            "2021/05/21 21:09:54\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:24  acc1: 75.0000 (75.0000)  acc5: 99.2188 (99.2188)  time: 0.6123  data: 0.5607  max mem: 281\n",
            "2021/05/21 21:09:56\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:09:56\tINFO\t__main__\t * Acc@1 79.9800\tAcc@5 98.7000\n",
            "\n",
            "2021/05/21 21:09:56\tINFO\ttorchdistill.misc.log\tEpoch: [87]  [  0/352]  eta: 0:03:50  lr: 0.1  img/s: 948.4949613443953  loss: 0.0604 (0.0604)  time: 0.6548  data: 0.5198  max mem: 281\n",
            "2021/05/21 21:10:00\tINFO\ttorchdistill.misc.log\tEpoch: [87]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 4311.419673473977  loss: 0.0764 (0.0755)  time: 0.0320  data: 0.0043  max mem: 281\n",
            "2021/05/21 21:10:03\tINFO\ttorchdistill.misc.log\tEpoch: [87]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 3539.707076501111  loss: 0.0800 (0.0864)  time: 0.0320  data: 0.0033  max mem: 281\n",
            "2021/05/21 21:10:06\tINFO\ttorchdistill.misc.log\tEpoch: [87]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 5198.509905687782  loss: 0.0842 (0.0898)  time: 0.0310  data: 0.0038  max mem: 281\n",
            "2021/05/21 21:10:08\tINFO\ttorchdistill.misc.log\tEpoch: [87] Total time: 0:00:12\n",
            "2021/05/21 21:10:08\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:24  acc1: 74.2188 (74.2188)  acc5: 97.6562 (97.6562)  time: 0.6087  data: 0.5489  max mem: 281\n",
            "2021/05/21 21:10:09\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:10:09\tINFO\t__main__\t * Acc@1 80.8400\tAcc@5 98.3600\n",
            "\n",
            "2021/05/21 21:10:10\tINFO\ttorchdistill.misc.log\tEpoch: [88]  [  0/352]  eta: 0:04:34  lr: 0.1  img/s: 1103.1767870315766  loss: 0.0388 (0.0388)  time: 0.7801  data: 0.6640  max mem: 281\n",
            "2021/05/21 21:10:14\tINFO\ttorchdistill.misc.log\tEpoch: [88]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 5453.622014769969  loss: 0.0531 (0.0683)  time: 0.0309  data: 0.0019  max mem: 281\n",
            "2021/05/21 21:10:17\tINFO\ttorchdistill.misc.log\tEpoch: [88]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 4670.960970262228  loss: 0.0979 (0.0755)  time: 0.0307  data: 0.0036  max mem: 281\n",
            "2021/05/21 21:10:20\tINFO\ttorchdistill.misc.log\tEpoch: [88]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 5576.373260210229  loss: 0.1211 (0.0845)  time: 0.0302  data: 0.0034  max mem: 281\n",
            "2021/05/21 21:10:21\tINFO\ttorchdistill.misc.log\tEpoch: [88] Total time: 0:00:12\n",
            "2021/05/21 21:10:22\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 75.7812 (75.7812)  acc5: 97.6562 (97.6562)  time: 0.5703  data: 0.5261  max mem: 281\n",
            "2021/05/21 21:10:23\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:10:23\tINFO\t__main__\t * Acc@1 80.6200\tAcc@5 99.0000\n",
            "\n",
            "2021/05/21 21:10:24\tINFO\ttorchdistill.misc.log\tEpoch: [89]  [  0/352]  eta: 0:03:55  lr: 0.1  img/s: 1038.2964594667249  loss: 0.0503 (0.0503)  time: 0.6698  data: 0.5465  max mem: 281\n",
            "2021/05/21 21:10:27\tINFO\ttorchdistill.misc.log\tEpoch: [89]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 3965.74685507878  loss: 0.0485 (0.0573)  time: 0.0302  data: 0.0019  max mem: 281\n",
            "2021/05/21 21:10:30\tINFO\ttorchdistill.misc.log\tEpoch: [89]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 5067.11446692842  loss: 0.0550 (0.0594)  time: 0.0319  data: 0.0026  max mem: 281\n",
            "2021/05/21 21:10:33\tINFO\ttorchdistill.misc.log\tEpoch: [89]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 5219.737803099539  loss: 0.0747 (0.0666)  time: 0.0312  data: 0.0035  max mem: 281\n",
            "2021/05/21 21:10:35\tINFO\ttorchdistill.misc.log\tEpoch: [89] Total time: 0:00:12\n",
            "2021/05/21 21:10:36\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 79.6875 (79.6875)  acc5: 97.6562 (97.6562)  time: 0.5398  data: 0.5138  max mem: 281\n",
            "2021/05/21 21:10:37\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:10:37\tINFO\t__main__\t * Acc@1 80.8600\tAcc@5 98.8400\n",
            "\n",
            "2021/05/21 21:10:37\tINFO\ttorchdistill.misc.log\tEpoch: [90]  [  0/352]  eta: 0:03:56  lr: 0.1  img/s: 865.658335859449  loss: 0.0377 (0.0377)  time: 0.6707  data: 0.5228  max mem: 281\n",
            "2021/05/21 21:10:41\tINFO\ttorchdistill.misc.log\tEpoch: [90]  [100/352]  eta: 0:00:10  lr: 0.1  img/s: 4990.758945088452  loss: 0.0592 (0.0674)  time: 0.0315  data: 0.0036  max mem: 281\n",
            "2021/05/21 21:10:44\tINFO\ttorchdistill.misc.log\tEpoch: [90]  [200/352]  eta: 0:00:05  lr: 0.1  img/s: 5217.810053259729  loss: 0.0629 (0.0637)  time: 0.0298  data: 0.0024  max mem: 281\n",
            "2021/05/21 21:10:47\tINFO\ttorchdistill.misc.log\tEpoch: [90]  [300/352]  eta: 0:00:01  lr: 0.1  img/s: 5257.049390936509  loss: 0.0716 (0.0707)  time: 0.0307  data: 0.0034  max mem: 281\n",
            "2021/05/21 21:10:49\tINFO\ttorchdistill.misc.log\tEpoch: [90] Total time: 0:00:12\n",
            "2021/05/21 21:10:49\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 73.4375 (73.4375)  acc5: 98.4375 (98.4375)  time: 0.5782  data: 0.5337  max mem: 281\n",
            "2021/05/21 21:10:50\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:10:50\tINFO\t__main__\t * Acc@1 80.2000\tAcc@5 98.4200\n",
            "\n",
            "2021/05/21 21:10:51\tINFO\ttorchdistill.misc.log\tEpoch: [91]  [  0/352]  eta: 0:03:53  lr: 0.010000000000000002  img/s: 1128.6388160107635  loss: 0.1038 (0.1038)  time: 0.6629  data: 0.5495  max mem: 281\n",
            "2021/05/21 21:10:55\tINFO\ttorchdistill.misc.log\tEpoch: [91]  [100/352]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 5314.132974353391  loss: 0.0248 (0.0452)  time: 0.0313  data: 0.0040  max mem: 281\n",
            "2021/05/21 21:10:58\tINFO\ttorchdistill.misc.log\tEpoch: [91]  [200/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 5265.505217732444  loss: 0.0205 (0.0361)  time: 0.0317  data: 0.0046  max mem: 281\n",
            "2021/05/21 21:11:01\tINFO\ttorchdistill.misc.log\tEpoch: [91]  [300/352]  eta: 0:00:01  lr: 0.010000000000000002  img/s: 5010.554672042409  loss: 0.0091 (0.0300)  time: 0.0311  data: 0.0029  max mem: 281\n",
            "2021/05/21 21:11:02\tINFO\ttorchdistill.misc.log\tEpoch: [91] Total time: 0:00:12\n",
            "2021/05/21 21:11:03\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 75.7812 (75.7812)  acc5: 100.0000 (100.0000)  time: 0.5591  data: 0.5268  max mem: 281\n",
            "2021/05/21 21:11:04\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:11:04\tINFO\t__main__\t * Acc@1 84.4000\tAcc@5 98.9800\n",
            "\n",
            "2021/05/21 21:11:04\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 82.1600 -> 84.4000)\n",
            "2021/05/21 21:11:05\tINFO\ttorchdistill.misc.log\tEpoch: [92]  [  0/352]  eta: 0:03:59  lr: 0.010000000000000002  img/s: 1137.8096073718968  loss: 0.0195 (0.0195)  time: 0.6803  data: 0.5678  max mem: 281\n",
            "2021/05/21 21:11:08\tINFO\ttorchdistill.misc.log\tEpoch: [92]  [100/352]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 5240.116657231538  loss: 0.0061 (0.0093)  time: 0.0308  data: 0.0035  max mem: 281\n",
            "2021/05/21 21:11:11\tINFO\ttorchdistill.misc.log\tEpoch: [92]  [200/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 5047.866711798112  loss: 0.0078 (0.0094)  time: 0.0298  data: 0.0039  max mem: 281\n",
            "2021/05/21 21:11:15\tINFO\ttorchdistill.misc.log\tEpoch: [92]  [300/352]  eta: 0:00:01  lr: 0.010000000000000002  img/s: 5109.893037643364  loss: 0.0067 (0.0089)  time: 0.0307  data: 0.0045  max mem: 281\n",
            "2021/05/21 21:11:16\tINFO\ttorchdistill.misc.log\tEpoch: [92] Total time: 0:00:12\n",
            "2021/05/21 21:11:17\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:25  acc1: 74.2188 (74.2188)  acc5: 100.0000 (100.0000)  time: 0.6258  data: 0.6015  max mem: 281\n",
            "2021/05/21 21:11:18\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:11:18\tINFO\t__main__\t * Acc@1 84.5000\tAcc@5 99.1000\n",
            "\n",
            "2021/05/21 21:11:18\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 84.4000 -> 84.5000)\n",
            "2021/05/21 21:11:18\tINFO\ttorchdistill.misc.log\tEpoch: [93]  [  0/352]  eta: 0:03:44  lr: 0.010000000000000002  img/s: 1224.0558869129047  loss: 0.0091 (0.0091)  time: 0.6391  data: 0.5345  max mem: 281\n",
            "2021/05/21 21:11:22\tINFO\ttorchdistill.misc.log\tEpoch: [93]  [100/352]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 4961.333986378464  loss: 0.0042 (0.0062)  time: 0.0302  data: 0.0016  max mem: 281\n",
            "2021/05/21 21:11:25\tINFO\ttorchdistill.misc.log\tEpoch: [93]  [200/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 2856.653623288655  loss: 0.0046 (0.0060)  time: 0.0320  data: 0.0040  max mem: 281\n",
            "2021/05/21 21:11:28\tINFO\ttorchdistill.misc.log\tEpoch: [93]  [300/352]  eta: 0:00:01  lr: 0.010000000000000002  img/s: 3890.0588503814915  loss: 0.0047 (0.0059)  time: 0.0315  data: 0.0043  max mem: 281\n",
            "2021/05/21 21:11:30\tINFO\ttorchdistill.misc.log\tEpoch: [93] Total time: 0:00:12\n",
            "2021/05/21 21:11:30\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 75.0000 (75.0000)  acc5: 100.0000 (100.0000)  time: 0.5630  data: 0.5193  max mem: 281\n",
            "2021/05/21 21:11:32\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:11:32\tINFO\t__main__\t * Acc@1 84.8000\tAcc@5 99.0000\n",
            "\n",
            "2021/05/21 21:11:32\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 84.5000 -> 84.8000)\n",
            "2021/05/21 21:11:32\tINFO\ttorchdistill.misc.log\tEpoch: [94]  [  0/352]  eta: 0:03:42  lr: 0.010000000000000002  img/s: 1051.5993481258618  loss: 0.0040 (0.0040)  time: 0.6326  data: 0.5109  max mem: 281\n",
            "2021/05/21 21:11:36\tINFO\ttorchdistill.misc.log\tEpoch: [94]  [100/352]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 5170.62256936753  loss: 0.0051 (0.0052)  time: 0.0290  data: 0.0023  max mem: 281\n",
            "2021/05/21 21:11:39\tINFO\ttorchdistill.misc.log\tEpoch: [94]  [200/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 2866.5526461919612  loss: 0.0042 (0.0050)  time: 0.0304  data: 0.0029  max mem: 281\n",
            "2021/05/21 21:11:42\tINFO\ttorchdistill.misc.log\tEpoch: [94]  [300/352]  eta: 0:00:01  lr: 0.010000000000000002  img/s: 5530.076759852496  loss: 0.0038 (0.0048)  time: 0.0307  data: 0.0045  max mem: 281\n",
            "2021/05/21 21:11:43\tINFO\ttorchdistill.misc.log\tEpoch: [94] Total time: 0:00:11\n",
            "2021/05/21 21:11:44\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:29  acc1: 75.0000 (75.0000)  acc5: 100.0000 (100.0000)  time: 0.7340  data: 0.7122  max mem: 281\n",
            "2021/05/21 21:11:45\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:11:45\tINFO\t__main__\t * Acc@1 84.7600\tAcc@5 99.1400\n",
            "\n",
            "2021/05/21 21:11:46\tINFO\ttorchdistill.misc.log\tEpoch: [95]  [  0/352]  eta: 0:03:40  lr: 0.010000000000000002  img/s: 1108.0126554325282  loss: 0.0028 (0.0028)  time: 0.6278  data: 0.5122  max mem: 281\n",
            "2021/05/21 21:11:49\tINFO\ttorchdistill.misc.log\tEpoch: [95]  [100/352]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 5258.95473468708  loss: 0.0033 (0.0040)  time: 0.0309  data: 0.0031  max mem: 281\n",
            "2021/05/21 21:11:52\tINFO\ttorchdistill.misc.log\tEpoch: [95]  [200/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 5127.119260447705  loss: 0.0030 (0.0038)  time: 0.0314  data: 0.0038  max mem: 281\n",
            "2021/05/21 21:11:56\tINFO\ttorchdistill.misc.log\tEpoch: [95]  [300/352]  eta: 0:00:01  lr: 0.010000000000000002  img/s: 3878.0322885891983  loss: 0.0036 (0.0038)  time: 0.0311  data: 0.0033  max mem: 281\n",
            "2021/05/21 21:11:57\tINFO\ttorchdistill.misc.log\tEpoch: [95] Total time: 0:00:12\n",
            "2021/05/21 21:11:58\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 75.7812 (75.7812)  acc5: 100.0000 (100.0000)  time: 0.5365  data: 0.4998  max mem: 281\n",
            "2021/05/21 21:11:59\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:11:59\tINFO\t__main__\t * Acc@1 84.9800\tAcc@5 98.9600\n",
            "\n",
            "2021/05/21 21:11:59\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 84.8000 -> 84.9800)\n",
            "2021/05/21 21:11:59\tINFO\ttorchdistill.misc.log\tEpoch: [96]  [  0/352]  eta: 0:03:42  lr: 0.010000000000000002  img/s: 929.7689600709357  loss: 0.0022 (0.0022)  time: 0.6313  data: 0.4936  max mem: 281\n",
            "2021/05/21 21:12:03\tINFO\ttorchdistill.misc.log\tEpoch: [96]  [100/352]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 5146.779967788941  loss: 0.0025 (0.0035)  time: 0.0305  data: 0.0029  max mem: 281\n",
            "2021/05/21 21:12:06\tINFO\ttorchdistill.misc.log\tEpoch: [96]  [200/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 3448.8864677352008  loss: 0.0027 (0.0035)  time: 0.0306  data: 0.0036  max mem: 281\n",
            "2021/05/21 21:12:09\tINFO\ttorchdistill.misc.log\tEpoch: [96]  [300/352]  eta: 0:00:01  lr: 0.010000000000000002  img/s: 4655.64979707933  loss: 0.0026 (0.0035)  time: 0.0321  data: 0.0046  max mem: 281\n",
            "2021/05/21 21:12:11\tINFO\ttorchdistill.misc.log\tEpoch: [96] Total time: 0:00:12\n",
            "2021/05/21 21:12:11\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:20  acc1: 75.0000 (75.0000)  acc5: 100.0000 (100.0000)  time: 0.5072  data: 0.4772  max mem: 281\n",
            "2021/05/21 21:12:12\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:12:12\tINFO\t__main__\t * Acc@1 85.1000\tAcc@5 99.1200\n",
            "\n",
            "2021/05/21 21:12:12\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 84.9800 -> 85.1000)\n",
            "2021/05/21 21:12:13\tINFO\ttorchdistill.misc.log\tEpoch: [97]  [  0/352]  eta: 0:03:46  lr: 0.010000000000000002  img/s: 972.8583579928568  loss: 0.0028 (0.0028)  time: 0.6431  data: 0.5115  max mem: 281\n",
            "2021/05/21 21:12:17\tINFO\ttorchdistill.misc.log\tEpoch: [97]  [100/352]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 5126.727578304049  loss: 0.0030 (0.0031)  time: 0.0298  data: 0.0034  max mem: 281\n",
            "2021/05/21 21:12:20\tINFO\ttorchdistill.misc.log\tEpoch: [97]  [200/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 4481.842187865229  loss: 0.0027 (0.0030)  time: 0.0312  data: 0.0036  max mem: 281\n",
            "2021/05/21 21:12:23\tINFO\ttorchdistill.misc.log\tEpoch: [97]  [300/352]  eta: 0:00:01  lr: 0.010000000000000002  img/s: 5411.677842066004  loss: 0.0024 (0.0030)  time: 0.0305  data: 0.0023  max mem: 281\n",
            "2021/05/21 21:12:24\tINFO\ttorchdistill.misc.log\tEpoch: [97] Total time: 0:00:12\n",
            "2021/05/21 21:12:25\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 76.5625 (76.5625)  acc5: 100.0000 (100.0000)  time: 0.5806  data: 0.5271  max mem: 281\n",
            "2021/05/21 21:12:26\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:12:26\tINFO\t__main__\t * Acc@1 85.2000\tAcc@5 99.0800\n",
            "\n",
            "2021/05/21 21:12:26\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 85.1000 -> 85.2000)\n",
            "2021/05/21 21:12:27\tINFO\ttorchdistill.misc.log\tEpoch: [98]  [  0/352]  eta: 0:04:27  lr: 0.010000000000000002  img/s: 1091.3851564389927  loss: 0.0032 (0.0032)  time: 0.7613  data: 0.6440  max mem: 281\n",
            "2021/05/21 21:12:30\tINFO\ttorchdistill.misc.log\tEpoch: [98]  [100/352]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 5034.470615815977  loss: 0.0020 (0.0029)  time: 0.0316  data: 0.0029  max mem: 281\n",
            "2021/05/21 21:12:33\tINFO\ttorchdistill.misc.log\tEpoch: [98]  [200/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 5056.9958931464525  loss: 0.0019 (0.0028)  time: 0.0298  data: 0.0039  max mem: 281\n",
            "2021/05/21 21:12:36\tINFO\ttorchdistill.misc.log\tEpoch: [98]  [300/352]  eta: 0:00:01  lr: 0.010000000000000002  img/s: 5033.337820987596  loss: 0.0021 (0.0027)  time: 0.0302  data: 0.0033  max mem: 281\n",
            "2021/05/21 21:12:38\tINFO\ttorchdistill.misc.log\tEpoch: [98] Total time: 0:00:11\n",
            "2021/05/21 21:12:39\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 75.7812 (75.7812)  acc5: 100.0000 (100.0000)  time: 0.5972  data: 0.5715  max mem: 281\n",
            "2021/05/21 21:12:40\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:12:40\tINFO\t__main__\t * Acc@1 85.1400\tAcc@5 98.9800\n",
            "\n",
            "2021/05/21 21:12:40\tINFO\ttorchdistill.misc.log\tEpoch: [99]  [  0/352]  eta: 0:04:05  lr: 0.010000000000000002  img/s: 1083.5173172361042  loss: 0.0020 (0.0020)  time: 0.6985  data: 0.5803  max mem: 281\n",
            "2021/05/21 21:12:44\tINFO\ttorchdistill.misc.log\tEpoch: [99]  [100/352]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 4988.023190129329  loss: 0.0021 (0.0024)  time: 0.0313  data: 0.0049  max mem: 281\n",
            "2021/05/21 21:12:47\tINFO\ttorchdistill.misc.log\tEpoch: [99]  [200/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 5495.208827202195  loss: 0.0019 (0.0024)  time: 0.0319  data: 0.0035  max mem: 281\n",
            "2021/05/21 21:12:50\tINFO\ttorchdistill.misc.log\tEpoch: [99]  [300/352]  eta: 0:00:01  lr: 0.010000000000000002  img/s: 3445.4336193452746  loss: 0.0024 (0.0025)  time: 0.0315  data: 0.0037  max mem: 281\n",
            "2021/05/21 21:12:52\tINFO\ttorchdistill.misc.log\tEpoch: [99] Total time: 0:00:12\n",
            "2021/05/21 21:12:52\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:24  acc1: 75.7812 (75.7812)  acc5: 100.0000 (100.0000)  time: 0.6036  data: 0.5411  max mem: 281\n",
            "2021/05/21 21:12:53\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:12:53\tINFO\t__main__\t * Acc@1 85.1600\tAcc@5 99.1200\n",
            "\n",
            "2021/05/21 21:12:54\tINFO\ttorchdistill.misc.log\tEpoch: [100]  [  0/352]  eta: 0:04:31  lr: 0.010000000000000002  img/s: 999.3539159149544  loss: 0.0029 (0.0029)  time: 0.7709  data: 0.6428  max mem: 281\n",
            "2021/05/21 21:12:58\tINFO\ttorchdistill.misc.log\tEpoch: [100]  [100/352]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 5278.810969194616  loss: 0.0022 (0.0024)  time: 0.0312  data: 0.0036  max mem: 281\n",
            "2021/05/21 21:13:01\tINFO\ttorchdistill.misc.log\tEpoch: [100]  [200/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 4340.630731293205  loss: 0.0019 (0.0024)  time: 0.0320  data: 0.0051  max mem: 281\n",
            "2021/05/21 21:13:04\tINFO\ttorchdistill.misc.log\tEpoch: [100]  [300/352]  eta: 0:00:01  lr: 0.010000000000000002  img/s: 4362.144318504977  loss: 0.0016 (0.0024)  time: 0.0304  data: 0.0036  max mem: 281\n",
            "2021/05/21 21:13:05\tINFO\ttorchdistill.misc.log\tEpoch: [100] Total time: 0:00:12\n",
            "2021/05/21 21:13:06\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:24  acc1: 76.5625 (76.5625)  acc5: 100.0000 (100.0000)  time: 0.6030  data: 0.5800  max mem: 281\n",
            "2021/05/21 21:13:07\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:13:07\tINFO\t__main__\t * Acc@1 85.1000\tAcc@5 99.0200\n",
            "\n",
            "2021/05/21 21:13:08\tINFO\ttorchdistill.misc.log\tEpoch: [101]  [  0/352]  eta: 0:03:36  lr: 0.010000000000000002  img/s: 1062.250399181653  loss: 0.0019 (0.0019)  time: 0.6137  data: 0.4932  max mem: 281\n",
            "2021/05/21 21:13:11\tINFO\ttorchdistill.misc.log\tEpoch: [101]  [100/352]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 3541.87884785391  loss: 0.0018 (0.0021)  time: 0.0325  data: 0.0049  max mem: 281\n",
            "2021/05/21 21:13:14\tINFO\ttorchdistill.misc.log\tEpoch: [101]  [200/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 5554.1051499037885  loss: 0.0019 (0.0021)  time: 0.0309  data: 0.0019  max mem: 281\n",
            "2021/05/21 21:13:18\tINFO\ttorchdistill.misc.log\tEpoch: [101]  [300/352]  eta: 0:00:01  lr: 0.010000000000000002  img/s: 5183.402481293749  loss: 0.0017 (0.0022)  time: 0.0318  data: 0.0044  max mem: 281\n",
            "2021/05/21 21:13:19\tINFO\ttorchdistill.misc.log\tEpoch: [101] Total time: 0:00:12\n",
            "2021/05/21 21:13:20\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 75.7812 (75.7812)  acc5: 100.0000 (100.0000)  time: 0.5460  data: 0.5206  max mem: 281\n",
            "2021/05/21 21:13:21\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:13:21\tINFO\t__main__\t * Acc@1 85.1400\tAcc@5 99.0400\n",
            "\n",
            "2021/05/21 21:13:22\tINFO\ttorchdistill.misc.log\tEpoch: [102]  [  0/352]  eta: 0:04:15  lr: 0.010000000000000002  img/s: 1259.9675474478936  loss: 0.0015 (0.0015)  time: 0.7271  data: 0.6255  max mem: 281\n",
            "2021/05/21 21:13:25\tINFO\ttorchdistill.misc.log\tEpoch: [102]  [100/352]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 4000.8563444097504  loss: 0.0024 (0.0022)  time: 0.0307  data: 0.0034  max mem: 281\n",
            "2021/05/21 21:13:28\tINFO\ttorchdistill.misc.log\tEpoch: [102]  [200/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 3509.740151406195  loss: 0.0015 (0.0022)  time: 0.0309  data: 0.0032  max mem: 281\n",
            "2021/05/21 21:13:31\tINFO\ttorchdistill.misc.log\tEpoch: [102]  [300/352]  eta: 0:00:01  lr: 0.010000000000000002  img/s: 3683.025279723398  loss: 0.0017 (0.0022)  time: 0.0319  data: 0.0035  max mem: 281\n",
            "2021/05/21 21:13:33\tINFO\ttorchdistill.misc.log\tEpoch: [102] Total time: 0:00:12\n",
            "2021/05/21 21:13:33\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:20  acc1: 75.7812 (75.7812)  acc5: 100.0000 (100.0000)  time: 0.5198  data: 0.4897  max mem: 281\n",
            "2021/05/21 21:13:34\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:13:34\tINFO\t__main__\t * Acc@1 85.1800\tAcc@5 99.0200\n",
            "\n",
            "2021/05/21 21:13:35\tINFO\ttorchdistill.misc.log\tEpoch: [103]  [  0/352]  eta: 0:03:37  lr: 0.010000000000000002  img/s: 1140.6524996281896  loss: 0.0018 (0.0018)  time: 0.6182  data: 0.5060  max mem: 281\n",
            "2021/05/21 21:13:39\tINFO\ttorchdistill.misc.log\tEpoch: [103]  [100/352]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 5201.582281301774  loss: 0.0014 (0.0020)  time: 0.0308  data: 0.0029  max mem: 281\n",
            "2021/05/21 21:13:42\tINFO\ttorchdistill.misc.log\tEpoch: [103]  [200/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 5321.612846310155  loss: 0.0015 (0.0019)  time: 0.0318  data: 0.0038  max mem: 281\n",
            "2021/05/21 21:13:45\tINFO\ttorchdistill.misc.log\tEpoch: [103]  [300/352]  eta: 0:00:01  lr: 0.010000000000000002  img/s: 4651.172706559124  loss: 0.0016 (0.0019)  time: 0.0298  data: 0.0035  max mem: 281\n",
            "2021/05/21 21:13:46\tINFO\ttorchdistill.misc.log\tEpoch: [103] Total time: 0:00:12\n",
            "2021/05/21 21:13:47\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 75.7812 (75.7812)  acc5: 100.0000 (100.0000)  time: 0.5883  data: 0.5579  max mem: 281\n",
            "2021/05/21 21:13:48\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:13:48\tINFO\t__main__\t * Acc@1 85.2400\tAcc@5 99.0200\n",
            "\n",
            "2021/05/21 21:13:48\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 85.2000 -> 85.2400)\n",
            "2021/05/21 21:13:49\tINFO\ttorchdistill.misc.log\tEpoch: [104]  [  0/352]  eta: 0:04:44  lr: 0.010000000000000002  img/s: 917.5429776557891  loss: 0.0014 (0.0014)  time: 0.8074  data: 0.6679  max mem: 281\n",
            "2021/05/21 21:13:52\tINFO\ttorchdistill.misc.log\tEpoch: [104]  [100/352]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 2856.6688234292524  loss: 0.0017 (0.0019)  time: 0.0317  data: 0.0039  max mem: 281\n",
            "2021/05/21 21:13:55\tINFO\ttorchdistill.misc.log\tEpoch: [104]  [200/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 5226.750574399314  loss: 0.0014 (0.0018)  time: 0.0310  data: 0.0031  max mem: 281\n",
            "2021/05/21 21:13:59\tINFO\ttorchdistill.misc.log\tEpoch: [104]  [300/352]  eta: 0:00:01  lr: 0.010000000000000002  img/s: 3279.562326666748  loss: 0.0017 (0.0019)  time: 0.0306  data: 0.0031  max mem: 281\n",
            "2021/05/21 21:14:00\tINFO\ttorchdistill.misc.log\tEpoch: [104] Total time: 0:00:12\n",
            "2021/05/21 21:14:01\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:27  acc1: 75.0000 (75.0000)  acc5: 100.0000 (100.0000)  time: 0.6819  data: 0.6561  max mem: 281\n",
            "2021/05/21 21:14:02\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:14:02\tINFO\t__main__\t * Acc@1 85.0200\tAcc@5 99.1000\n",
            "\n",
            "2021/05/21 21:14:03\tINFO\ttorchdistill.misc.log\tEpoch: [105]  [  0/352]  eta: 0:04:58  lr: 0.010000000000000002  img/s: 1320.666917579917  loss: 0.0014 (0.0014)  time: 0.8483  data: 0.7514  max mem: 281\n",
            "2021/05/21 21:14:06\tINFO\ttorchdistill.misc.log\tEpoch: [105]  [100/352]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 5287.3370035158905  loss: 0.0014 (0.0018)  time: 0.0311  data: 0.0029  max mem: 281\n",
            "2021/05/21 21:14:09\tINFO\ttorchdistill.misc.log\tEpoch: [105]  [200/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 5290.098259858502  loss: 0.0017 (0.0017)  time: 0.0314  data: 0.0030  max mem: 281\n",
            "2021/05/21 21:14:12\tINFO\ttorchdistill.misc.log\tEpoch: [105]  [300/352]  eta: 0:00:01  lr: 0.010000000000000002  img/s: 5006.022770292321  loss: 0.0015 (0.0018)  time: 0.0315  data: 0.0042  max mem: 281\n",
            "2021/05/21 21:14:14\tINFO\ttorchdistill.misc.log\tEpoch: [105] Total time: 0:00:12\n",
            "2021/05/21 21:14:15\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 75.0000 (75.0000)  acc5: 100.0000 (100.0000)  time: 0.5802  data: 0.5379  max mem: 281\n",
            "2021/05/21 21:14:16\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:14:16\tINFO\t__main__\t * Acc@1 85.0800\tAcc@5 99.1200\n",
            "\n",
            "2021/05/21 21:14:16\tINFO\ttorchdistill.misc.log\tEpoch: [106]  [  0/352]  eta: 0:03:37  lr: 0.010000000000000002  img/s: 1223.6848196967176  loss: 0.0016 (0.0016)  time: 0.6187  data: 0.5141  max mem: 281\n",
            "2021/05/21 21:14:20\tINFO\ttorchdistill.misc.log\tEpoch: [106]  [100/352]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 5044.072607012665  loss: 0.0013 (0.0016)  time: 0.0306  data: 0.0036  max mem: 281\n",
            "2021/05/21 21:14:23\tINFO\ttorchdistill.misc.log\tEpoch: [106]  [200/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 5281.979024419039  loss: 0.0015 (0.0018)  time: 0.0307  data: 0.0024  max mem: 281\n",
            "2021/05/21 21:14:26\tINFO\ttorchdistill.misc.log\tEpoch: [106]  [300/352]  eta: 0:00:01  lr: 0.010000000000000002  img/s: 5301.381574010072  loss: 0.0017 (0.0018)  time: 0.0299  data: 0.0037  max mem: 281\n",
            "2021/05/21 21:14:28\tINFO\ttorchdistill.misc.log\tEpoch: [106] Total time: 0:00:11\n",
            "2021/05/21 21:14:28\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:20  acc1: 75.7812 (75.7812)  acc5: 100.0000 (100.0000)  time: 0.5104  data: 0.4825  max mem: 281\n",
            "2021/05/21 21:14:29\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:14:29\tINFO\t__main__\t * Acc@1 85.0800\tAcc@5 99.0600\n",
            "\n",
            "2021/05/21 21:14:30\tINFO\ttorchdistill.misc.log\tEpoch: [107]  [  0/352]  eta: 0:04:47  lr: 0.010000000000000002  img/s: 1115.0708084441749  loss: 0.0011 (0.0011)  time: 0.8163  data: 0.7015  max mem: 281\n",
            "2021/05/21 21:14:33\tINFO\ttorchdistill.misc.log\tEpoch: [107]  [100/352]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 5051.428872517195  loss: 0.0015 (0.0017)  time: 0.0318  data: 0.0044  max mem: 281\n",
            "2021/05/21 21:14:36\tINFO\ttorchdistill.misc.log\tEpoch: [107]  [200/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 5185.505220557697  loss: 0.0014 (0.0017)  time: 0.0311  data: 0.0036  max mem: 281\n",
            "2021/05/21 21:14:39\tINFO\ttorchdistill.misc.log\tEpoch: [107]  [300/352]  eta: 0:00:01  lr: 0.010000000000000002  img/s: 5243.238424501675  loss: 0.0013 (0.0017)  time: 0.0302  data: 0.0038  max mem: 281\n",
            "2021/05/21 21:14:41\tINFO\ttorchdistill.misc.log\tEpoch: [107] Total time: 0:00:12\n",
            "2021/05/21 21:14:42\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 76.5625 (76.5625)  acc5: 100.0000 (100.0000)  time: 0.5541  data: 0.5238  max mem: 281\n",
            "2021/05/21 21:14:43\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:14:43\tINFO\t__main__\t * Acc@1 85.1000\tAcc@5 99.0800\n",
            "\n",
            "2021/05/21 21:14:43\tINFO\ttorchdistill.misc.log\tEpoch: [108]  [  0/352]  eta: 0:04:03  lr: 0.010000000000000002  img/s: 791.6920359045671  loss: 0.0008 (0.0008)  time: 0.6929  data: 0.5312  max mem: 281\n",
            "2021/05/21 21:14:47\tINFO\ttorchdistill.misc.log\tEpoch: [108]  [100/352]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 5284.578628238444  loss: 0.0013 (0.0015)  time: 0.0320  data: 0.0042  max mem: 281\n",
            "2021/05/21 21:14:50\tINFO\ttorchdistill.misc.log\tEpoch: [108]  [200/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 5112.7641468106585  loss: 0.0014 (0.0015)  time: 0.0311  data: 0.0027  max mem: 281\n",
            "2021/05/21 21:14:53\tINFO\ttorchdistill.misc.log\tEpoch: [108]  [300/352]  eta: 0:00:01  lr: 0.010000000000000002  img/s: 5025.093243976862  loss: 0.0016 (0.0016)  time: 0.0310  data: 0.0022  max mem: 281\n",
            "2021/05/21 21:14:55\tINFO\ttorchdistill.misc.log\tEpoch: [108] Total time: 0:00:12\n",
            "2021/05/21 21:14:55\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 75.7812 (75.7812)  acc5: 99.2188 (99.2188)  time: 0.5472  data: 0.5225  max mem: 281\n",
            "2021/05/21 21:14:56\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:14:56\tINFO\t__main__\t * Acc@1 85.0800\tAcc@5 99.0400\n",
            "\n",
            "2021/05/21 21:14:57\tINFO\ttorchdistill.misc.log\tEpoch: [109]  [  0/352]  eta: 0:03:35  lr: 0.010000000000000002  img/s: 1212.3990542368517  loss: 0.0024 (0.0024)  time: 0.6120  data: 0.5064  max mem: 281\n",
            "2021/05/21 21:15:01\tINFO\ttorchdistill.misc.log\tEpoch: [109]  [100/352]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 4845.1429705972605  loss: 0.0013 (0.0015)  time: 0.0301  data: 0.0036  max mem: 281\n",
            "2021/05/21 21:15:04\tINFO\ttorchdistill.misc.log\tEpoch: [109]  [200/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 4339.543082543891  loss: 0.0013 (0.0015)  time: 0.0307  data: 0.0028  max mem: 281\n",
            "2021/05/21 21:15:07\tINFO\ttorchdistill.misc.log\tEpoch: [109]  [300/352]  eta: 0:00:01  lr: 0.010000000000000002  img/s: 3333.214823644819  loss: 0.0016 (0.0016)  time: 0.0308  data: 0.0022  max mem: 281\n",
            "2021/05/21 21:15:08\tINFO\ttorchdistill.misc.log\tEpoch: [109] Total time: 0:00:12\n",
            "2021/05/21 21:15:09\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:27  acc1: 76.5625 (76.5625)  acc5: 100.0000 (100.0000)  time: 0.6761  data: 0.6508  max mem: 281\n",
            "2021/05/21 21:15:10\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:15:10\tINFO\t__main__\t * Acc@1 84.9000\tAcc@5 99.1400\n",
            "\n",
            "2021/05/21 21:15:11\tINFO\ttorchdistill.misc.log\tEpoch: [110]  [  0/352]  eta: 0:03:31  lr: 0.010000000000000002  img/s: 1090.8684588032104  loss: 0.0009 (0.0009)  time: 0.6019  data: 0.4845  max mem: 281\n",
            "2021/05/21 21:15:14\tINFO\ttorchdistill.misc.log\tEpoch: [110]  [100/352]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 4095.312615375227  loss: 0.0013 (0.0016)  time: 0.0308  data: 0.0037  max mem: 281\n",
            "2021/05/21 21:15:17\tINFO\ttorchdistill.misc.log\tEpoch: [110]  [200/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 4183.094613652478  loss: 0.0013 (0.0016)  time: 0.0306  data: 0.0026  max mem: 281\n",
            "2021/05/21 21:15:20\tINFO\ttorchdistill.misc.log\tEpoch: [110]  [300/352]  eta: 0:00:01  lr: 0.010000000000000002  img/s: 4957.5772395261  loss: 0.0011 (0.0015)  time: 0.0307  data: 0.0034  max mem: 281\n",
            "2021/05/21 21:15:22\tINFO\ttorchdistill.misc.log\tEpoch: [110] Total time: 0:00:12\n",
            "2021/05/21 21:15:23\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 75.7812 (75.7812)  acc5: 100.0000 (100.0000)  time: 0.5583  data: 0.5356  max mem: 281\n",
            "2021/05/21 21:15:24\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:15:24\tINFO\t__main__\t * Acc@1 84.8400\tAcc@5 99.1200\n",
            "\n",
            "2021/05/21 21:15:24\tINFO\ttorchdistill.misc.log\tEpoch: [111]  [  0/352]  eta: 0:04:05  lr: 0.010000000000000002  img/s: 1161.6735410134738  loss: 0.0010 (0.0010)  time: 0.6968  data: 0.5866  max mem: 281\n",
            "2021/05/21 21:15:28\tINFO\ttorchdistill.misc.log\tEpoch: [111]  [100/352]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 5254.476794487835  loss: 0.0012 (0.0015)  time: 0.0300  data: 0.0028  max mem: 281\n",
            "2021/05/21 21:15:31\tINFO\ttorchdistill.misc.log\tEpoch: [111]  [200/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 4799.017725773436  loss: 0.0012 (0.0015)  time: 0.0313  data: 0.0030  max mem: 281\n",
            "2021/05/21 21:15:34\tINFO\ttorchdistill.misc.log\tEpoch: [111]  [300/352]  eta: 0:00:01  lr: 0.010000000000000002  img/s: 4483.8260491919655  loss: 0.0013 (0.0014)  time: 0.0311  data: 0.0038  max mem: 281\n",
            "2021/05/21 21:15:36\tINFO\ttorchdistill.misc.log\tEpoch: [111] Total time: 0:00:12\n",
            "2021/05/21 21:15:36\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 76.5625 (76.5625)  acc5: 100.0000 (100.0000)  time: 0.5744  data: 0.5199  max mem: 281\n",
            "2021/05/21 21:15:37\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:15:37\tINFO\t__main__\t * Acc@1 84.8800\tAcc@5 98.9800\n",
            "\n",
            "2021/05/21 21:15:38\tINFO\ttorchdistill.misc.log\tEpoch: [112]  [  0/352]  eta: 0:04:28  lr: 0.010000000000000002  img/s: 1137.3998169553574  loss: 0.0011 (0.0011)  time: 0.7622  data: 0.6497  max mem: 281\n",
            "2021/05/21 21:15:42\tINFO\ttorchdistill.misc.log\tEpoch: [112]  [100/352]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 5337.378706989969  loss: 0.0012 (0.0015)  time: 0.0308  data: 0.0039  max mem: 281\n",
            "2021/05/21 21:15:45\tINFO\ttorchdistill.misc.log\tEpoch: [112]  [200/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 4414.911614749515  loss: 0.0013 (0.0015)  time: 0.0312  data: 0.0046  max mem: 281\n",
            "2021/05/21 21:15:48\tINFO\ttorchdistill.misc.log\tEpoch: [112]  [300/352]  eta: 0:00:01  lr: 0.010000000000000002  img/s: 4501.458185903778  loss: 0.0014 (0.0016)  time: 0.0303  data: 0.0040  max mem: 281\n",
            "2021/05/21 21:15:49\tINFO\ttorchdistill.misc.log\tEpoch: [112] Total time: 0:00:12\n",
            "2021/05/21 21:15:50\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:28  acc1: 75.0000 (75.0000)  acc5: 99.2188 (99.2188)  time: 0.7131  data: 0.6790  max mem: 281\n",
            "2021/05/21 21:15:51\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:15:51\tINFO\t__main__\t * Acc@1 84.8400\tAcc@5 99.0600\n",
            "\n",
            "2021/05/21 21:15:52\tINFO\ttorchdistill.misc.log\tEpoch: [113]  [  0/352]  eta: 0:03:48  lr: 0.010000000000000002  img/s: 1172.1381315948622  loss: 0.0025 (0.0025)  time: 0.6477  data: 0.5385  max mem: 281\n",
            "2021/05/21 21:15:55\tINFO\ttorchdistill.misc.log\tEpoch: [113]  [100/352]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 5174.5097683922395  loss: 0.0012 (0.0015)  time: 0.0320  data: 0.0029  max mem: 281\n",
            "2021/05/21 21:15:58\tINFO\ttorchdistill.misc.log\tEpoch: [113]  [200/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 4804.471935853379  loss: 0.0013 (0.0014)  time: 0.0319  data: 0.0032  max mem: 281\n",
            "2021/05/21 21:16:02\tINFO\ttorchdistill.misc.log\tEpoch: [113]  [300/352]  eta: 0:00:01  lr: 0.010000000000000002  img/s: 5237.662796823477  loss: 0.0012 (0.0014)  time: 0.0318  data: 0.0036  max mem: 281\n",
            "2021/05/21 21:16:03\tINFO\ttorchdistill.misc.log\tEpoch: [113] Total time: 0:00:12\n",
            "2021/05/21 21:16:04\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 75.0000 (75.0000)  acc5: 99.2188 (99.2188)  time: 0.5692  data: 0.5334  max mem: 281\n",
            "2021/05/21 21:16:05\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:16:05\tINFO\t__main__\t * Acc@1 85.0400\tAcc@5 99.0400\n",
            "\n",
            "2021/05/21 21:16:06\tINFO\ttorchdistill.misc.log\tEpoch: [114]  [  0/352]  eta: 0:03:42  lr: 0.010000000000000002  img/s: 1003.8047401446424  loss: 0.0009 (0.0009)  time: 0.6310  data: 0.5034  max mem: 281\n",
            "2021/05/21 21:16:09\tINFO\ttorchdistill.misc.log\tEpoch: [114]  [100/352]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 5333.084118091151  loss: 0.0011 (0.0013)  time: 0.0312  data: 0.0032  max mem: 281\n",
            "2021/05/21 21:16:12\tINFO\ttorchdistill.misc.log\tEpoch: [114]  [200/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 5047.629413036733  loss: 0.0013 (0.0014)  time: 0.0313  data: 0.0053  max mem: 281\n",
            "2021/05/21 21:16:15\tINFO\ttorchdistill.misc.log\tEpoch: [114]  [300/352]  eta: 0:00:01  lr: 0.010000000000000002  img/s: 4888.288159667844  loss: 0.0013 (0.0014)  time: 0.0313  data: 0.0051  max mem: 281\n",
            "2021/05/21 21:16:17\tINFO\ttorchdistill.misc.log\tEpoch: [114] Total time: 0:00:12\n",
            "2021/05/21 21:16:18\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:26  acc1: 75.7812 (75.7812)  acc5: 99.2188 (99.2188)  time: 0.6734  data: 0.6365  max mem: 281\n",
            "2021/05/21 21:16:19\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:16:19\tINFO\t__main__\t * Acc@1 85.1200\tAcc@5 99.0600\n",
            "\n",
            "2021/05/21 21:16:20\tINFO\ttorchdistill.misc.log\tEpoch: [115]  [  0/352]  eta: 0:03:36  lr: 0.010000000000000002  img/s: 1067.8855397002837  loss: 0.0023 (0.0023)  time: 0.6150  data: 0.4952  max mem: 281\n",
            "2021/05/21 21:16:23\tINFO\ttorchdistill.misc.log\tEpoch: [115]  [100/352]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 4661.6731528997025  loss: 0.0011 (0.0013)  time: 0.0312  data: 0.0037  max mem: 281\n",
            "2021/05/21 21:16:26\tINFO\ttorchdistill.misc.log\tEpoch: [115]  [200/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 5060.237068315488  loss: 0.0013 (0.0014)  time: 0.0301  data: 0.0023  max mem: 281\n",
            "2021/05/21 21:16:29\tINFO\ttorchdistill.misc.log\tEpoch: [115]  [300/352]  eta: 0:00:01  lr: 0.010000000000000002  img/s: 5354.25263787773  loss: 0.0011 (0.0014)  time: 0.0309  data: 0.0047  max mem: 281\n",
            "2021/05/21 21:16:31\tINFO\ttorchdistill.misc.log\tEpoch: [115] Total time: 0:00:12\n",
            "2021/05/21 21:16:32\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 75.7812 (75.7812)  acc5: 99.2188 (99.2188)  time: 0.5257  data: 0.4982  max mem: 281\n",
            "2021/05/21 21:16:33\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:16:33\tINFO\t__main__\t * Acc@1 84.9200\tAcc@5 99.0200\n",
            "\n",
            "2021/05/21 21:16:33\tINFO\ttorchdistill.misc.log\tEpoch: [116]  [  0/352]  eta: 0:03:42  lr: 0.010000000000000002  img/s: 1093.8288978806809  loss: 0.0040 (0.0040)  time: 0.6329  data: 0.5158  max mem: 281\n",
            "2021/05/21 21:16:37\tINFO\ttorchdistill.misc.log\tEpoch: [116]  [100/352]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 5174.011082948643  loss: 0.0010 (0.0014)  time: 0.0301  data: 0.0035  max mem: 281\n",
            "2021/05/21 21:16:40\tINFO\ttorchdistill.misc.log\tEpoch: [116]  [200/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 5015.001092916593  loss: 0.0012 (0.0014)  time: 0.0311  data: 0.0040  max mem: 281\n",
            "2021/05/21 21:16:43\tINFO\ttorchdistill.misc.log\tEpoch: [116]  [300/352]  eta: 0:00:01  lr: 0.010000000000000002  img/s: 5047.534499779059  loss: 0.0012 (0.0014)  time: 0.0318  data: 0.0044  max mem: 281\n",
            "2021/05/21 21:16:45\tINFO\ttorchdistill.misc.log\tEpoch: [116] Total time: 0:00:12\n",
            "2021/05/21 21:16:45\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:20  acc1: 75.0000 (75.0000)  acc5: 99.2188 (99.2188)  time: 0.5073  data: 0.4970  max mem: 281\n",
            "2021/05/21 21:16:46\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:16:46\tINFO\t__main__\t * Acc@1 85.1200\tAcc@5 99.0600\n",
            "\n",
            "2021/05/21 21:16:47\tINFO\ttorchdistill.misc.log\tEpoch: [117]  [  0/352]  eta: 0:04:27  lr: 0.010000000000000002  img/s: 1206.516558196397  loss: 0.0025 (0.0025)  time: 0.7595  data: 0.6534  max mem: 281\n",
            "2021/05/21 21:16:50\tINFO\ttorchdistill.misc.log\tEpoch: [117]  [100/352]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 4878.294203701853  loss: 0.0012 (0.0013)  time: 0.0306  data: 0.0029  max mem: 281\n",
            "2021/05/21 21:16:54\tINFO\ttorchdistill.misc.log\tEpoch: [117]  [200/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 5113.884266976558  loss: 0.0011 (0.0013)  time: 0.0305  data: 0.0034  max mem: 281\n",
            "2021/05/21 21:16:57\tINFO\ttorchdistill.misc.log\tEpoch: [117]  [300/352]  eta: 0:00:01  lr: 0.010000000000000002  img/s: 5151.669292698608  loss: 0.0012 (0.0013)  time: 0.0304  data: 0.0036  max mem: 281\n",
            "2021/05/21 21:16:58\tINFO\ttorchdistill.misc.log\tEpoch: [117] Total time: 0:00:12\n",
            "2021/05/21 21:16:59\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:26  acc1: 75.7812 (75.7812)  acc5: 99.2188 (99.2188)  time: 0.6558  data: 0.6282  max mem: 281\n",
            "2021/05/21 21:17:00\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:17:00\tINFO\t__main__\t * Acc@1 85.1200\tAcc@5 99.0600\n",
            "\n",
            "2021/05/21 21:17:01\tINFO\ttorchdistill.misc.log\tEpoch: [118]  [  0/352]  eta: 0:03:42  lr: 0.010000000000000002  img/s: 894.7252049863342  loss: 0.0015 (0.0015)  time: 0.6317  data: 0.4886  max mem: 281\n",
            "2021/05/21 21:17:04\tINFO\ttorchdistill.misc.log\tEpoch: [118]  [100/352]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 5182.852045643233  loss: 0.0012 (0.0013)  time: 0.0309  data: 0.0041  max mem: 281\n",
            "2021/05/21 21:17:07\tINFO\ttorchdistill.misc.log\tEpoch: [118]  [200/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 4134.546877165961  loss: 0.0012 (0.0013)  time: 0.0307  data: 0.0034  max mem: 281\n",
            "2021/05/21 21:17:10\tINFO\ttorchdistill.misc.log\tEpoch: [118]  [300/352]  eta: 0:00:01  lr: 0.010000000000000002  img/s: 4225.167528430331  loss: 0.0009 (0.0013)  time: 0.0302  data: 0.0035  max mem: 281\n",
            "2021/05/21 21:17:12\tINFO\ttorchdistill.misc.log\tEpoch: [118] Total time: 0:00:11\n",
            "2021/05/21 21:17:12\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 76.5625 (76.5625)  acc5: 100.0000 (100.0000)  time: 0.5466  data: 0.4982  max mem: 281\n",
            "2021/05/21 21:17:14\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:17:14\tINFO\t__main__\t * Acc@1 85.1000\tAcc@5 99.1200\n",
            "\n",
            "2021/05/21 21:17:14\tINFO\ttorchdistill.misc.log\tEpoch: [119]  [  0/352]  eta: 0:03:56  lr: 0.010000000000000002  img/s: 981.9743564418009  loss: 0.0017 (0.0017)  time: 0.6731  data: 0.5427  max mem: 281\n",
            "2021/05/21 21:17:18\tINFO\ttorchdistill.misc.log\tEpoch: [119]  [100/352]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 3255.519110307984  loss: 0.0010 (0.0013)  time: 0.0306  data: 0.0035  max mem: 281\n",
            "2021/05/21 21:17:21\tINFO\ttorchdistill.misc.log\tEpoch: [119]  [200/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 5080.68508266379  loss: 0.0012 (0.0013)  time: 0.0309  data: 0.0031  max mem: 281\n",
            "2021/05/21 21:17:24\tINFO\ttorchdistill.misc.log\tEpoch: [119]  [300/352]  eta: 0:00:01  lr: 0.010000000000000002  img/s: 4998.984245223286  loss: 0.0010 (0.0013)  time: 0.0315  data: 0.0036  max mem: 281\n",
            "2021/05/21 21:17:26\tINFO\ttorchdistill.misc.log\tEpoch: [119] Total time: 0:00:12\n",
            "2021/05/21 21:17:26\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 77.3438 (77.3438)  acc5: 100.0000 (100.0000)  time: 0.5434  data: 0.5046  max mem: 281\n",
            "2021/05/21 21:17:27\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:17:27\tINFO\t__main__\t * Acc@1 84.8400\tAcc@5 99.0800\n",
            "\n",
            "2021/05/21 21:17:28\tINFO\ttorchdistill.misc.log\tEpoch: [120]  [  0/352]  eta: 0:03:33  lr: 0.010000000000000002  img/s: 1176.2650891722537  loss: 0.0011 (0.0011)  time: 0.6072  data: 0.4983  max mem: 281\n",
            "2021/05/21 21:17:31\tINFO\ttorchdistill.misc.log\tEpoch: [120]  [100/352]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 5160.483606478589  loss: 0.0011 (0.0013)  time: 0.0316  data: 0.0036  max mem: 281\n",
            "2021/05/21 21:17:34\tINFO\ttorchdistill.misc.log\tEpoch: [120]  [200/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 5253.859745953458  loss: 0.0012 (0.0013)  time: 0.0305  data: 0.0031  max mem: 281\n",
            "2021/05/21 21:17:37\tINFO\ttorchdistill.misc.log\tEpoch: [120]  [300/352]  eta: 0:00:01  lr: 0.010000000000000002  img/s: 3924.3228513369295  loss: 0.0012 (0.0013)  time: 0.0292  data: 0.0024  max mem: 281\n",
            "2021/05/21 21:17:39\tINFO\ttorchdistill.misc.log\tEpoch: [120] Total time: 0:00:11\n",
            "2021/05/21 21:17:40\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 76.5625 (76.5625)  acc5: 99.2188 (99.2188)  time: 0.5763  data: 0.5386  max mem: 281\n",
            "2021/05/21 21:17:41\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:17:41\tINFO\t__main__\t * Acc@1 85.0400\tAcc@5 99.0800\n",
            "\n",
            "2021/05/21 21:17:41\tINFO\ttorchdistill.misc.log\tEpoch: [121]  [  0/352]  eta: 0:03:39  lr: 0.010000000000000002  img/s: 1439.0544238109535  loss: 0.0016 (0.0016)  time: 0.6227  data: 0.5337  max mem: 281\n",
            "2021/05/21 21:17:45\tINFO\ttorchdistill.misc.log\tEpoch: [121]  [100/352]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 3233.675121216684  loss: 0.0010 (0.0012)  time: 0.0311  data: 0.0037  max mem: 281\n",
            "2021/05/21 21:17:48\tINFO\ttorchdistill.misc.log\tEpoch: [121]  [200/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 5403.942827233563  loss: 0.0012 (0.0013)  time: 0.0309  data: 0.0051  max mem: 281\n",
            "2021/05/21 21:17:51\tINFO\ttorchdistill.misc.log\tEpoch: [121]  [300/352]  eta: 0:00:01  lr: 0.010000000000000002  img/s: 5368.601747965041  loss: 0.0011 (0.0013)  time: 0.0310  data: 0.0047  max mem: 281\n",
            "2021/05/21 21:17:53\tINFO\ttorchdistill.misc.log\tEpoch: [121] Total time: 0:00:11\n",
            "2021/05/21 21:17:53\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 75.7812 (75.7812)  acc5: 99.2188 (99.2188)  time: 0.5440  data: 0.5226  max mem: 281\n",
            "2021/05/21 21:17:54\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:17:54\tINFO\t__main__\t * Acc@1 85.0800\tAcc@5 99.1000\n",
            "\n",
            "2021/05/21 21:17:55\tINFO\ttorchdistill.misc.log\tEpoch: [122]  [  0/352]  eta: 0:03:43  lr: 0.010000000000000002  img/s: 913.8570499661264  loss: 0.0011 (0.0011)  time: 0.6342  data: 0.4941  max mem: 281\n",
            "2021/05/21 21:17:58\tINFO\ttorchdistill.misc.log\tEpoch: [122]  [100/352]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 5011.536886125813  loss: 0.0013 (0.0013)  time: 0.0321  data: 0.0038  max mem: 281\n",
            "2021/05/21 21:18:01\tINFO\ttorchdistill.misc.log\tEpoch: [122]  [200/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 5308.248173306044  loss: 0.0009 (0.0013)  time: 0.0306  data: 0.0044  max mem: 281\n",
            "2021/05/21 21:18:05\tINFO\ttorchdistill.misc.log\tEpoch: [122]  [300/352]  eta: 0:00:01  lr: 0.010000000000000002  img/s: 4956.387263545638  loss: 0.0014 (0.0013)  time: 0.0291  data: 0.0036  max mem: 281\n",
            "2021/05/21 21:18:06\tINFO\ttorchdistill.misc.log\tEpoch: [122] Total time: 0:00:11\n",
            "2021/05/21 21:18:07\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 75.7812 (75.7812)  acc5: 100.0000 (100.0000)  time: 0.5302  data: 0.4947  max mem: 281\n",
            "2021/05/21 21:18:08\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:18:08\tINFO\t__main__\t * Acc@1 85.1200\tAcc@5 99.0600\n",
            "\n",
            "2021/05/21 21:18:08\tINFO\ttorchdistill.misc.log\tEpoch: [123]  [  0/352]  eta: 0:03:42  lr: 0.010000000000000002  img/s: 953.5997044373474  loss: 0.0008 (0.0008)  time: 0.6327  data: 0.4985  max mem: 281\n",
            "2021/05/21 21:18:12\tINFO\ttorchdistill.misc.log\tEpoch: [123]  [100/352]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 4250.355564000253  loss: 0.0011 (0.0012)  time: 0.0325  data: 0.0037  max mem: 281\n",
            "2021/05/21 21:18:15\tINFO\ttorchdistill.misc.log\tEpoch: [123]  [200/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 4612.1741879504825  loss: 0.0012 (0.0012)  time: 0.0316  data: 0.0053  max mem: 281\n",
            "2021/05/21 21:18:18\tINFO\ttorchdistill.misc.log\tEpoch: [123]  [300/352]  eta: 0:00:01  lr: 0.010000000000000002  img/s: 5352.971384130656  loss: 0.0013 (0.0012)  time: 0.0327  data: 0.0032  max mem: 281\n",
            "2021/05/21 21:18:20\tINFO\ttorchdistill.misc.log\tEpoch: [123] Total time: 0:00:12\n",
            "2021/05/21 21:18:21\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:24  acc1: 76.5625 (76.5625)  acc5: 99.2188 (99.2188)  time: 0.6220  data: 0.6059  max mem: 281\n",
            "2021/05/21 21:18:22\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:18:22\tINFO\t__main__\t * Acc@1 84.9000\tAcc@5 99.0200\n",
            "\n",
            "2021/05/21 21:18:22\tINFO\ttorchdistill.misc.log\tEpoch: [124]  [  0/352]  eta: 0:03:45  lr: 0.010000000000000002  img/s: 932.9162501998346  loss: 0.0007 (0.0007)  time: 0.6403  data: 0.5031  max mem: 281\n",
            "2021/05/21 21:18:26\tINFO\ttorchdistill.misc.log\tEpoch: [124]  [100/352]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 5151.224424785554  loss: 0.0011 (0.0012)  time: 0.0308  data: 0.0033  max mem: 281\n",
            "2021/05/21 21:18:29\tINFO\ttorchdistill.misc.log\tEpoch: [124]  [200/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 3577.183886142242  loss: 0.0012 (0.0013)  time: 0.0303  data: 0.0024  max mem: 281\n",
            "2021/05/21 21:18:32\tINFO\ttorchdistill.misc.log\tEpoch: [124]  [300/352]  eta: 0:00:01  lr: 0.010000000000000002  img/s: 5121.054904803694  loss: 0.0013 (0.0012)  time: 0.0298  data: 0.0026  max mem: 281\n",
            "2021/05/21 21:18:34\tINFO\ttorchdistill.misc.log\tEpoch: [124] Total time: 0:00:11\n",
            "2021/05/21 21:18:34\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 76.5625 (76.5625)  acc5: 99.2188 (99.2188)  time: 0.5305  data: 0.5205  max mem: 281\n",
            "2021/05/21 21:18:35\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:18:35\tINFO\t__main__\t * Acc@1 85.0600\tAcc@5 99.1200\n",
            "\n",
            "2021/05/21 21:18:36\tINFO\ttorchdistill.misc.log\tEpoch: [125]  [  0/352]  eta: 0:04:27  lr: 0.010000000000000002  img/s: 1102.1237138798335  loss: 0.0007 (0.0007)  time: 0.7609  data: 0.6447  max mem: 281\n",
            "2021/05/21 21:18:39\tINFO\ttorchdistill.misc.log\tEpoch: [125]  [100/352]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 5003.689938953353  loss: 0.0011 (0.0012)  time: 0.0306  data: 0.0019  max mem: 281\n",
            "2021/05/21 21:18:43\tINFO\ttorchdistill.misc.log\tEpoch: [125]  [200/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 4925.9183220324985  loss: 0.0012 (0.0012)  time: 0.0309  data: 0.0045  max mem: 281\n",
            "2021/05/21 21:18:46\tINFO\ttorchdistill.misc.log\tEpoch: [125]  [300/352]  eta: 0:00:01  lr: 0.010000000000000002  img/s: 5234.24145697043  loss: 0.0011 (0.0012)  time: 0.0304  data: 0.0029  max mem: 281\n",
            "2021/05/21 21:18:47\tINFO\ttorchdistill.misc.log\tEpoch: [125] Total time: 0:00:12\n",
            "2021/05/21 21:18:48\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 77.3438 (77.3438)  acc5: 99.2188 (99.2188)  time: 0.5838  data: 0.5605  max mem: 281\n",
            "2021/05/21 21:18:49\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:18:49\tINFO\t__main__\t * Acc@1 85.0600\tAcc@5 99.1200\n",
            "\n",
            "2021/05/21 21:18:50\tINFO\ttorchdistill.misc.log\tEpoch: [126]  [  0/352]  eta: 0:03:33  lr: 0.010000000000000002  img/s: 1318.8792775618697  loss: 0.0028 (0.0028)  time: 0.6071  data: 0.5101  max mem: 281\n",
            "2021/05/21 21:18:53\tINFO\ttorchdistill.misc.log\tEpoch: [126]  [100/352]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 5349.291192969521  loss: 0.0013 (0.0013)  time: 0.0310  data: 0.0020  max mem: 281\n",
            "2021/05/21 21:18:56\tINFO\ttorchdistill.misc.log\tEpoch: [126]  [200/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 5083.908562337834  loss: 0.0010 (0.0013)  time: 0.0318  data: 0.0026  max mem: 281\n",
            "2021/05/21 21:18:59\tINFO\ttorchdistill.misc.log\tEpoch: [126]  [300/352]  eta: 0:00:01  lr: 0.010000000000000002  img/s: 5009.619587936698  loss: 0.0012 (0.0013)  time: 0.0299  data: 0.0026  max mem: 281\n",
            "2021/05/21 21:19:01\tINFO\ttorchdistill.misc.log\tEpoch: [126] Total time: 0:00:11\n",
            "2021/05/21 21:19:01\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:20  acc1: 76.5625 (76.5625)  acc5: 99.2188 (99.2188)  time: 0.5113  data: 0.4798  max mem: 281\n",
            "2021/05/21 21:19:03\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:19:03\tINFO\t__main__\t * Acc@1 84.9200\tAcc@5 99.0400\n",
            "\n",
            "2021/05/21 21:19:03\tINFO\ttorchdistill.misc.log\tEpoch: [127]  [  0/352]  eta: 0:03:39  lr: 0.010000000000000002  img/s: 1295.7317745415578  loss: 0.0011 (0.0011)  time: 0.6224  data: 0.5236  max mem: 281\n",
            "2021/05/21 21:19:07\tINFO\ttorchdistill.misc.log\tEpoch: [127]  [100/352]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 3087.3280542856323  loss: 0.0009 (0.0012)  time: 0.0340  data: 0.0046  max mem: 281\n",
            "2021/05/21 21:19:10\tINFO\ttorchdistill.misc.log\tEpoch: [127]  [200/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 3679.0375461703456  loss: 0.0014 (0.0013)  time: 0.0320  data: 0.0036  max mem: 281\n",
            "2021/05/21 21:19:13\tINFO\ttorchdistill.misc.log\tEpoch: [127]  [300/352]  eta: 0:00:01  lr: 0.010000000000000002  img/s: 5145.201564057349  loss: 0.0010 (0.0012)  time: 0.0321  data: 0.0036  max mem: 281\n",
            "2021/05/21 21:19:15\tINFO\ttorchdistill.misc.log\tEpoch: [127] Total time: 0:00:12\n",
            "2021/05/21 21:19:16\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:27  acc1: 75.7812 (75.7812)  acc5: 99.2188 (99.2188)  time: 0.6902  data: 0.6616  max mem: 281\n",
            "2021/05/21 21:19:17\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:19:17\tINFO\t__main__\t * Acc@1 85.2400\tAcc@5 99.0400\n",
            "\n",
            "2021/05/21 21:19:18\tINFO\ttorchdistill.misc.log\tEpoch: [128]  [  0/352]  eta: 0:04:17  lr: 0.010000000000000002  img/s: 1002.68176716128  loss: 0.0013 (0.0013)  time: 0.7316  data: 0.6039  max mem: 281\n",
            "2021/05/21 21:19:21\tINFO\ttorchdistill.misc.log\tEpoch: [128]  [100/352]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 3193.4551857051083  loss: 0.0010 (0.0012)  time: 0.0321  data: 0.0035  max mem: 281\n",
            "2021/05/21 21:19:25\tINFO\ttorchdistill.misc.log\tEpoch: [128]  [200/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 3433.9079977485544  loss: 0.0011 (0.0012)  time: 0.0335  data: 0.0050  max mem: 281\n",
            "2021/05/21 21:19:28\tINFO\ttorchdistill.misc.log\tEpoch: [128]  [300/352]  eta: 0:00:01  lr: 0.010000000000000002  img/s: 2661.9146197554614  loss: 0.0009 (0.0012)  time: 0.0353  data: 0.0049  max mem: 281\n",
            "2021/05/21 21:19:30\tINFO\ttorchdistill.misc.log\tEpoch: [128] Total time: 0:00:12\n",
            "2021/05/21 21:19:30\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 77.3438 (77.3438)  acc5: 100.0000 (100.0000)  time: 0.5858  data: 0.5406  max mem: 281\n",
            "2021/05/21 21:19:31\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:19:31\tINFO\t__main__\t * Acc@1 84.9600\tAcc@5 99.0800\n",
            "\n",
            "2021/05/21 21:19:32\tINFO\ttorchdistill.misc.log\tEpoch: [129]  [  0/352]  eta: 0:03:48  lr: 0.010000000000000002  img/s: 1023.0282667601651  loss: 0.0008 (0.0008)  time: 0.6494  data: 0.5243  max mem: 281\n",
            "2021/05/21 21:19:36\tINFO\ttorchdistill.misc.log\tEpoch: [129]  [100/352]  eta: 0:00:11  lr: 0.010000000000000002  img/s: 4840.817925251341  loss: 0.0009 (0.0011)  time: 0.0336  data: 0.0042  max mem: 281\n",
            "2021/05/21 21:19:39\tINFO\ttorchdistill.misc.log\tEpoch: [129]  [200/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 4767.69365753157  loss: 0.0010 (0.0011)  time: 0.0317  data: 0.0044  max mem: 281\n",
            "2021/05/21 21:19:42\tINFO\ttorchdistill.misc.log\tEpoch: [129]  [300/352]  eta: 0:00:01  lr: 0.010000000000000002  img/s: 5035.131648300117  loss: 0.0010 (0.0012)  time: 0.0318  data: 0.0022  max mem: 281\n",
            "2021/05/21 21:19:44\tINFO\ttorchdistill.misc.log\tEpoch: [129] Total time: 0:00:12\n",
            "2021/05/21 21:19:44\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 77.3438 (77.3438)  acc5: 99.2188 (99.2188)  time: 0.5680  data: 0.5203  max mem: 281\n",
            "2021/05/21 21:19:46\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:19:46\tINFO\t__main__\t * Acc@1 85.0600\tAcc@5 99.0400\n",
            "\n",
            "2021/05/21 21:19:46\tINFO\ttorchdistill.misc.log\tEpoch: [130]  [  0/352]  eta: 0:03:48  lr: 0.010000000000000002  img/s: 1218.2037317310594  loss: 0.0011 (0.0011)  time: 0.6490  data: 0.5439  max mem: 281\n",
            "2021/05/21 21:19:50\tINFO\ttorchdistill.misc.log\tEpoch: [130]  [100/352]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 5171.270030245237  loss: 0.0010 (0.0012)  time: 0.0335  data: 0.0044  max mem: 281\n",
            "2021/05/21 21:19:53\tINFO\ttorchdistill.misc.log\tEpoch: [130]  [200/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 4715.847229542181  loss: 0.0009 (0.0012)  time: 0.0316  data: 0.0046  max mem: 281\n",
            "2021/05/21 21:19:56\tINFO\ttorchdistill.misc.log\tEpoch: [130]  [300/352]  eta: 0:00:01  lr: 0.010000000000000002  img/s: 4227.829365673111  loss: 0.0010 (0.0012)  time: 0.0310  data: 0.0036  max mem: 281\n",
            "2021/05/21 21:19:58\tINFO\ttorchdistill.misc.log\tEpoch: [130] Total time: 0:00:12\n",
            "2021/05/21 21:19:58\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 76.5625 (76.5625)  acc5: 99.2188 (99.2188)  time: 0.5900  data: 0.5677  max mem: 281\n",
            "2021/05/21 21:19:59\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:19:59\tINFO\t__main__\t * Acc@1 85.0000\tAcc@5 99.1000\n",
            "\n",
            "2021/05/21 21:20:00\tINFO\ttorchdistill.misc.log\tEpoch: [131]  [  0/352]  eta: 0:03:52  lr: 0.010000000000000002  img/s: 886.560526845959  loss: 0.0009 (0.0009)  time: 0.6609  data: 0.5165  max mem: 281\n",
            "2021/05/21 21:20:04\tINFO\ttorchdistill.misc.log\tEpoch: [131]  [100/352]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 5111.693186578817  loss: 0.0010 (0.0012)  time: 0.0310  data: 0.0039  max mem: 281\n",
            "2021/05/21 21:20:07\tINFO\ttorchdistill.misc.log\tEpoch: [131]  [200/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 4027.327237129333  loss: 0.0009 (0.0012)  time: 0.0314  data: 0.0035  max mem: 281\n",
            "2021/05/21 21:20:10\tINFO\ttorchdistill.misc.log\tEpoch: [131]  [300/352]  eta: 0:00:01  lr: 0.010000000000000002  img/s: 4034.4999774554744  loss: 0.0008 (0.0012)  time: 0.0324  data: 0.0037  max mem: 281\n",
            "2021/05/21 21:20:12\tINFO\ttorchdistill.misc.log\tEpoch: [131] Total time: 0:00:12\n",
            "2021/05/21 21:20:12\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 77.3438 (77.3438)  acc5: 99.2188 (99.2188)  time: 0.5587  data: 0.5042  max mem: 281\n",
            "2021/05/21 21:20:13\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:20:13\tINFO\t__main__\t * Acc@1 84.6800\tAcc@5 99.1000\n",
            "\n",
            "2021/05/21 21:20:14\tINFO\ttorchdistill.misc.log\tEpoch: [132]  [  0/352]  eta: 0:03:41  lr: 0.010000000000000002  img/s: 1176.8478147454812  loss: 0.0015 (0.0015)  time: 0.6295  data: 0.5207  max mem: 281\n",
            "2021/05/21 21:20:17\tINFO\ttorchdistill.misc.log\tEpoch: [132]  [100/352]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 5024.199743582545  loss: 0.0009 (0.0012)  time: 0.0296  data: 0.0025  max mem: 281\n",
            "2021/05/21 21:20:20\tINFO\ttorchdistill.misc.log\tEpoch: [132]  [200/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 5031.120907131478  loss: 0.0011 (0.0012)  time: 0.0314  data: 0.0042  max mem: 281\n",
            "2021/05/21 21:20:24\tINFO\ttorchdistill.misc.log\tEpoch: [132]  [300/352]  eta: 0:00:01  lr: 0.010000000000000002  img/s: 5425.623914866955  loss: 0.0009 (0.0012)  time: 0.0307  data: 0.0036  max mem: 281\n",
            "2021/05/21 21:20:25\tINFO\ttorchdistill.misc.log\tEpoch: [132] Total time: 0:00:11\n",
            "2021/05/21 21:20:26\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 77.3438 (77.3438)  acc5: 99.2188 (99.2188)  time: 0.5397  data: 0.5143  max mem: 281\n",
            "2021/05/21 21:20:27\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:20:27\tINFO\t__main__\t * Acc@1 85.1400\tAcc@5 99.1000\n",
            "\n",
            "2021/05/21 21:20:27\tINFO\ttorchdistill.misc.log\tEpoch: [133]  [  0/352]  eta: 0:03:54  lr: 0.010000000000000002  img/s: 905.981271885046  loss: 0.0008 (0.0008)  time: 0.6650  data: 0.5237  max mem: 281\n",
            "2021/05/21 21:20:31\tINFO\ttorchdistill.misc.log\tEpoch: [133]  [100/352]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 4162.370811431052  loss: 0.0009 (0.0011)  time: 0.0320  data: 0.0037  max mem: 281\n",
            "2021/05/21 21:20:34\tINFO\ttorchdistill.misc.log\tEpoch: [133]  [200/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 5252.934444835819  loss: 0.0010 (0.0011)  time: 0.0311  data: 0.0024  max mem: 281\n",
            "2021/05/21 21:20:37\tINFO\ttorchdistill.misc.log\tEpoch: [133]  [300/352]  eta: 0:00:01  lr: 0.010000000000000002  img/s: 5387.457472002569  loss: 0.0009 (0.0011)  time: 0.0309  data: 0.0019  max mem: 281\n",
            "2021/05/21 21:20:39\tINFO\ttorchdistill.misc.log\tEpoch: [133] Total time: 0:00:12\n",
            "2021/05/21 21:20:39\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 78.1250 (78.1250)  acc5: 100.0000 (100.0000)  time: 0.5990  data: 0.5837  max mem: 281\n",
            "2021/05/21 21:20:40\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:20:40\tINFO\t__main__\t * Acc@1 85.1800\tAcc@5 99.0600\n",
            "\n",
            "2021/05/21 21:20:41\tINFO\ttorchdistill.misc.log\tEpoch: [134]  [  0/352]  eta: 0:04:03  lr: 0.010000000000000002  img/s: 907.7674406808032  loss: 0.0008 (0.0008)  time: 0.6908  data: 0.5498  max mem: 281\n",
            "2021/05/21 21:20:45\tINFO\ttorchdistill.misc.log\tEpoch: [134]  [100/352]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 4243.300864671756  loss: 0.0011 (0.0011)  time: 0.0314  data: 0.0041  max mem: 281\n",
            "2021/05/21 21:20:48\tINFO\ttorchdistill.misc.log\tEpoch: [134]  [200/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 5486.1119149805845  loss: 0.0011 (0.0011)  time: 0.0309  data: 0.0023  max mem: 281\n",
            "2021/05/21 21:20:51\tINFO\ttorchdistill.misc.log\tEpoch: [134]  [300/352]  eta: 0:00:01  lr: 0.010000000000000002  img/s: 5428.476647893305  loss: 0.0010 (0.0011)  time: 0.0313  data: 0.0034  max mem: 281\n",
            "2021/05/21 21:20:53\tINFO\ttorchdistill.misc.log\tEpoch: [134] Total time: 0:00:12\n",
            "2021/05/21 21:20:53\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 75.7812 (75.7812)  acc5: 99.2188 (99.2188)  time: 0.5683  data: 0.5274  max mem: 281\n",
            "2021/05/21 21:20:54\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:20:54\tINFO\t__main__\t * Acc@1 85.0800\tAcc@5 99.0400\n",
            "\n",
            "2021/05/21 21:20:55\tINFO\ttorchdistill.misc.log\tEpoch: [135]  [  0/352]  eta: 0:03:22  lr: 0.010000000000000002  img/s: 1248.9930323397148  loss: 0.0008 (0.0008)  time: 0.5758  data: 0.4733  max mem: 281\n",
            "2021/05/21 21:20:58\tINFO\ttorchdistill.misc.log\tEpoch: [135]  [100/352]  eta: 0:00:10  lr: 0.010000000000000002  img/s: 3085.500477016977  loss: 0.0011 (0.0012)  time: 0.0314  data: 0.0042  max mem: 281\n",
            "2021/05/21 21:21:01\tINFO\ttorchdistill.misc.log\tEpoch: [135]  [200/352]  eta: 0:00:05  lr: 0.010000000000000002  img/s: 4288.072076101628  loss: 0.0010 (0.0012)  time: 0.0305  data: 0.0029  max mem: 281\n",
            "2021/05/21 21:21:05\tINFO\ttorchdistill.misc.log\tEpoch: [135]  [300/352]  eta: 0:00:01  lr: 0.010000000000000002  img/s: 5526.717987255639  loss: 0.0011 (0.0012)  time: 0.0309  data: 0.0037  max mem: 281\n",
            "2021/05/21 21:21:06\tINFO\ttorchdistill.misc.log\tEpoch: [135] Total time: 0:00:12\n",
            "2021/05/21 21:21:07\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:29  acc1: 77.3438 (77.3438)  acc5: 99.2188 (99.2188)  time: 0.7403  data: 0.7063  max mem: 281\n",
            "2021/05/21 21:21:08\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:21:08\tINFO\t__main__\t * Acc@1 85.0400\tAcc@5 99.1000\n",
            "\n",
            "2021/05/21 21:21:08\tINFO\ttorchdistill.misc.log\tEpoch: [136]  [  0/352]  eta: 0:03:45  lr: 0.0010000000000000002  img/s: 914.2040714851299  loss: 0.0007 (0.0007)  time: 0.6413  data: 0.5012  max mem: 281\n",
            "2021/05/21 21:21:12\tINFO\ttorchdistill.misc.log\tEpoch: [136]  [100/352]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 5402.202777218757  loss: 0.0011 (0.0011)  time: 0.0305  data: 0.0040  max mem: 281\n",
            "2021/05/21 21:21:15\tINFO\ttorchdistill.misc.log\tEpoch: [136]  [200/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 4892.564721321037  loss: 0.0010 (0.0011)  time: 0.0322  data: 0.0045  max mem: 281\n",
            "2021/05/21 21:21:18\tINFO\ttorchdistill.misc.log\tEpoch: [136]  [300/352]  eta: 0:00:01  lr: 0.0010000000000000002  img/s: 5214.313303095347  loss: 0.0011 (0.0011)  time: 0.0308  data: 0.0041  max mem: 281\n",
            "2021/05/21 21:21:20\tINFO\ttorchdistill.misc.log\tEpoch: [136] Total time: 0:00:12\n",
            "2021/05/21 21:21:20\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 76.5625 (76.5625)  acc5: 99.2188 (99.2188)  time: 0.5721  data: 0.5458  max mem: 281\n",
            "2021/05/21 21:21:21\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:21:21\tINFO\t__main__\t * Acc@1 85.1800\tAcc@5 99.0400\n",
            "\n",
            "2021/05/21 21:21:22\tINFO\ttorchdistill.misc.log\tEpoch: [137]  [  0/352]  eta: 0:03:56  lr: 0.0010000000000000002  img/s: 929.1896487268599  loss: 0.0012 (0.0012)  time: 0.6717  data: 0.5339  max mem: 281\n",
            "2021/05/21 21:21:26\tINFO\ttorchdistill.misc.log\tEpoch: [137]  [100/352]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 3512.8863762767537  loss: 0.0008 (0.0011)  time: 0.0316  data: 0.0048  max mem: 281\n",
            "2021/05/21 21:21:29\tINFO\ttorchdistill.misc.log\tEpoch: [137]  [200/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 4938.242519569157  loss: 0.0009 (0.0011)  time: 0.0321  data: 0.0041  max mem: 281\n",
            "2021/05/21 21:21:32\tINFO\ttorchdistill.misc.log\tEpoch: [137]  [300/352]  eta: 0:00:01  lr: 0.0010000000000000002  img/s: 4983.439418551763  loss: 0.0009 (0.0011)  time: 0.0308  data: 0.0034  max mem: 281\n",
            "2021/05/21 21:21:33\tINFO\ttorchdistill.misc.log\tEpoch: [137] Total time: 0:00:12\n",
            "2021/05/21 21:21:34\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:28  acc1: 75.7812 (75.7812)  acc5: 99.2188 (99.2188)  time: 0.7186  data: 0.6850  max mem: 281\n",
            "2021/05/21 21:21:35\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:21:35\tINFO\t__main__\t * Acc@1 85.3000\tAcc@5 99.0800\n",
            "\n",
            "2021/05/21 21:21:35\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 85.2400 -> 85.3000)\n",
            "2021/05/21 21:21:36\tINFO\ttorchdistill.misc.log\tEpoch: [138]  [  0/352]  eta: 0:03:47  lr: 0.0010000000000000002  img/s: 921.3109305418508  loss: 0.0007 (0.0007)  time: 0.6472  data: 0.5083  max mem: 281\n",
            "2021/05/21 21:21:39\tINFO\ttorchdistill.misc.log\tEpoch: [138]  [100/352]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 5376.343527809489  loss: 0.0009 (0.0011)  time: 0.0322  data: 0.0044  max mem: 281\n",
            "2021/05/21 21:21:43\tINFO\ttorchdistill.misc.log\tEpoch: [138]  [200/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 4311.765936086995  loss: 0.0009 (0.0011)  time: 0.0316  data: 0.0036  max mem: 281\n",
            "2021/05/21 21:21:46\tINFO\ttorchdistill.misc.log\tEpoch: [138]  [300/352]  eta: 0:00:01  lr: 0.0010000000000000002  img/s: 5356.389424324055  loss: 0.0011 (0.0011)  time: 0.0307  data: 0.0045  max mem: 281\n",
            "2021/05/21 21:21:47\tINFO\ttorchdistill.misc.log\tEpoch: [138] Total time: 0:00:12\n",
            "2021/05/21 21:21:48\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:28  acc1: 77.3438 (77.3438)  acc5: 100.0000 (100.0000)  time: 0.7115  data: 0.6917  max mem: 281\n",
            "2021/05/21 21:21:49\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:21:49\tINFO\t__main__\t * Acc@1 85.0400\tAcc@5 99.1000\n",
            "\n",
            "2021/05/21 21:21:50\tINFO\ttorchdistill.misc.log\tEpoch: [139]  [  0/352]  eta: 0:03:39  lr: 0.0010000000000000002  img/s: 1162.7881397413962  loss: 0.0016 (0.0016)  time: 0.6222  data: 0.5121  max mem: 281\n",
            "2021/05/21 21:21:53\tINFO\ttorchdistill.misc.log\tEpoch: [139]  [100/352]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 5279.122412657207  loss: 0.0010 (0.0011)  time: 0.0308  data: 0.0032  max mem: 281\n",
            "2021/05/21 21:21:56\tINFO\ttorchdistill.misc.log\tEpoch: [139]  [200/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 4794.988719689189  loss: 0.0011 (0.0011)  time: 0.0309  data: 0.0025  max mem: 281\n",
            "2021/05/21 21:21:59\tINFO\ttorchdistill.misc.log\tEpoch: [139]  [300/352]  eta: 0:00:01  lr: 0.0010000000000000002  img/s: 4248.135846428967  loss: 0.0009 (0.0011)  time: 0.0303  data: 0.0034  max mem: 281\n",
            "2021/05/21 21:22:01\tINFO\ttorchdistill.misc.log\tEpoch: [139] Total time: 0:00:12\n",
            "2021/05/21 21:22:02\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:20  acc1: 76.5625 (76.5625)  acc5: 99.2188 (99.2188)  time: 0.5069  data: 0.4862  max mem: 281\n",
            "2021/05/21 21:22:03\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:22:03\tINFO\t__main__\t * Acc@1 85.1000\tAcc@5 99.0600\n",
            "\n",
            "2021/05/21 21:22:03\tINFO\ttorchdistill.misc.log\tEpoch: [140]  [  0/352]  eta: 0:04:06  lr: 0.0010000000000000002  img/s: 869.8181723917812  loss: 0.0020 (0.0020)  time: 0.6989  data: 0.5517  max mem: 281\n",
            "2021/05/21 21:22:07\tINFO\ttorchdistill.misc.log\tEpoch: [140]  [100/352]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 4194.271232255998  loss: 0.0010 (0.0011)  time: 0.0304  data: 0.0029  max mem: 281\n",
            "2021/05/21 21:22:10\tINFO\ttorchdistill.misc.log\tEpoch: [140]  [200/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 5368.870186105583  loss: 0.0010 (0.0012)  time: 0.0312  data: 0.0034  max mem: 281\n",
            "2021/05/21 21:22:13\tINFO\ttorchdistill.misc.log\tEpoch: [140]  [300/352]  eta: 0:00:01  lr: 0.0010000000000000002  img/s: 2856.1217202562084  loss: 0.0009 (0.0012)  time: 0.0312  data: 0.0033  max mem: 281\n",
            "2021/05/21 21:22:15\tINFO\ttorchdistill.misc.log\tEpoch: [140] Total time: 0:00:12\n",
            "2021/05/21 21:22:15\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:25  acc1: 78.1250 (78.1250)  acc5: 99.2188 (99.2188)  time: 0.6395  data: 0.6127  max mem: 281\n",
            "2021/05/21 21:22:16\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:22:16\tINFO\t__main__\t * Acc@1 84.9800\tAcc@5 98.9800\n",
            "\n",
            "2021/05/21 21:22:17\tINFO\ttorchdistill.misc.log\tEpoch: [141]  [  0/352]  eta: 0:03:41  lr: 0.0010000000000000002  img/s: 1037.6522777788516  loss: 0.0007 (0.0007)  time: 0.6286  data: 0.5052  max mem: 281\n",
            "2021/05/21 21:22:21\tINFO\ttorchdistill.misc.log\tEpoch: [141]  [100/352]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 3608.9250749519365  loss: 0.0011 (0.0012)  time: 0.0338  data: 0.0044  max mem: 281\n",
            "2021/05/21 21:22:24\tINFO\ttorchdistill.misc.log\tEpoch: [141]  [200/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 5002.804033024582  loss: 0.0010 (0.0011)  time: 0.0322  data: 0.0044  max mem: 281\n",
            "2021/05/21 21:22:27\tINFO\ttorchdistill.misc.log\tEpoch: [141]  [300/352]  eta: 0:00:01  lr: 0.0010000000000000002  img/s: 3920.0533897995692  loss: 0.0009 (0.0011)  time: 0.0311  data: 0.0023  max mem: 281\n",
            "2021/05/21 21:22:29\tINFO\ttorchdistill.misc.log\tEpoch: [141] Total time: 0:00:12\n",
            "2021/05/21 21:22:29\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 76.5625 (76.5625)  acc5: 99.2188 (99.2188)  time: 0.5518  data: 0.5198  max mem: 281\n",
            "2021/05/21 21:22:30\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:22:30\tINFO\t__main__\t * Acc@1 84.9800\tAcc@5 99.0200\n",
            "\n",
            "2021/05/21 21:22:31\tINFO\ttorchdistill.misc.log\tEpoch: [142]  [  0/352]  eta: 0:04:25  lr: 0.0010000000000000002  img/s: 718.344963418485  loss: 0.0011 (0.0011)  time: 0.7536  data: 0.5754  max mem: 281\n",
            "2021/05/21 21:22:35\tINFO\ttorchdistill.misc.log\tEpoch: [142]  [100/352]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 5333.1370955725315  loss: 0.0010 (0.0011)  time: 0.0309  data: 0.0024  max mem: 281\n",
            "2021/05/21 21:22:38\tINFO\ttorchdistill.misc.log\tEpoch: [142]  [200/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 5254.6825095429185  loss: 0.0011 (0.0012)  time: 0.0310  data: 0.0036  max mem: 281\n",
            "2021/05/21 21:22:41\tINFO\ttorchdistill.misc.log\tEpoch: [142]  [300/352]  eta: 0:00:01  lr: 0.0010000000000000002  img/s: 4106.9667844739215  loss: 0.0009 (0.0012)  time: 0.0304  data: 0.0030  max mem: 281\n",
            "2021/05/21 21:22:43\tINFO\ttorchdistill.misc.log\tEpoch: [142] Total time: 0:00:12\n",
            "2021/05/21 21:22:43\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 78.1250 (78.1250)  acc5: 99.2188 (99.2188)  time: 0.5771  data: 0.5382  max mem: 281\n",
            "2021/05/21 21:22:44\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:22:44\tINFO\t__main__\t * Acc@1 84.9400\tAcc@5 99.0600\n",
            "\n",
            "2021/05/21 21:22:45\tINFO\ttorchdistill.misc.log\tEpoch: [143]  [  0/352]  eta: 0:04:53  lr: 0.0010000000000000002  img/s: 873.5901014877384  loss: 0.0008 (0.0008)  time: 0.8347  data: 0.6882  max mem: 281\n",
            "2021/05/21 21:22:48\tINFO\ttorchdistill.misc.log\tEpoch: [143]  [100/352]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 5398.45460487285  loss: 0.0009 (0.0012)  time: 0.0309  data: 0.0030  max mem: 281\n",
            "2021/05/21 21:22:52\tINFO\ttorchdistill.misc.log\tEpoch: [143]  [200/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 5276.3725995086  loss: 0.0011 (0.0012)  time: 0.0317  data: 0.0028  max mem: 281\n",
            "2021/05/21 21:22:55\tINFO\ttorchdistill.misc.log\tEpoch: [143]  [300/352]  eta: 0:00:01  lr: 0.0010000000000000002  img/s: 4830.060745645603  loss: 0.0010 (0.0012)  time: 0.0314  data: 0.0032  max mem: 281\n",
            "2021/05/21 21:22:56\tINFO\ttorchdistill.misc.log\tEpoch: [143] Total time: 0:00:12\n",
            "2021/05/21 21:22:57\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:24  acc1: 76.5625 (76.5625)  acc5: 99.2188 (99.2188)  time: 0.6048  data: 0.5909  max mem: 281\n",
            "2021/05/21 21:22:58\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:22:58\tINFO\t__main__\t * Acc@1 85.1200\tAcc@5 99.0400\n",
            "\n",
            "2021/05/21 21:22:59\tINFO\ttorchdistill.misc.log\tEpoch: [144]  [  0/352]  eta: 0:03:50  lr: 0.0010000000000000002  img/s: 919.7499323298739  loss: 0.0009 (0.0009)  time: 0.6534  data: 0.5143  max mem: 281\n",
            "2021/05/21 21:23:02\tINFO\ttorchdistill.misc.log\tEpoch: [144]  [100/352]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 4969.5085020317865  loss: 0.0010 (0.0011)  time: 0.0306  data: 0.0031  max mem: 281\n",
            "2021/05/21 21:23:05\tINFO\ttorchdistill.misc.log\tEpoch: [144]  [200/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 5341.892818053372  loss: 0.0009 (0.0011)  time: 0.0314  data: 0.0051  max mem: 281\n",
            "2021/05/21 21:23:08\tINFO\ttorchdistill.misc.log\tEpoch: [144]  [300/352]  eta: 0:00:01  lr: 0.0010000000000000002  img/s: 4293.490335324648  loss: 0.0009 (0.0012)  time: 0.0305  data: 0.0027  max mem: 281\n",
            "2021/05/21 21:23:10\tINFO\ttorchdistill.misc.log\tEpoch: [144] Total time: 0:00:12\n",
            "2021/05/21 21:23:11\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 78.1250 (78.1250)  acc5: 99.2188 (99.2188)  time: 0.5686  data: 0.5341  max mem: 281\n",
            "2021/05/21 21:23:12\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:23:12\tINFO\t__main__\t * Acc@1 85.0000\tAcc@5 99.0200\n",
            "\n",
            "2021/05/21 21:23:13\tINFO\ttorchdistill.misc.log\tEpoch: [145]  [  0/352]  eta: 0:04:52  lr: 0.0010000000000000002  img/s: 977.239430261661  loss: 0.0008 (0.0008)  time: 0.8317  data: 0.7007  max mem: 281\n",
            "2021/05/21 21:23:16\tINFO\ttorchdistill.misc.log\tEpoch: [145]  [100/352]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 5039.006898623091  loss: 0.0009 (0.0011)  time: 0.0318  data: 0.0032  max mem: 281\n",
            "2021/05/21 21:23:19\tINFO\ttorchdistill.misc.log\tEpoch: [145]  [200/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 5286.712213567567  loss: 0.0010 (0.0011)  time: 0.0317  data: 0.0037  max mem: 281\n",
            "2021/05/21 21:23:22\tINFO\ttorchdistill.misc.log\tEpoch: [145]  [300/352]  eta: 0:00:01  lr: 0.0010000000000000002  img/s: 5177.3041843062  loss: 0.0012 (0.0012)  time: 0.0331  data: 0.0031  max mem: 281\n",
            "2021/05/21 21:23:24\tINFO\ttorchdistill.misc.log\tEpoch: [145] Total time: 0:00:12\n",
            "2021/05/21 21:23:24\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 76.5625 (76.5625)  acc5: 99.2188 (99.2188)  time: 0.5372  data: 0.5008  max mem: 281\n",
            "2021/05/21 21:23:25\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:23:25\tINFO\t__main__\t * Acc@1 85.0600\tAcc@5 98.9800\n",
            "\n",
            "2021/05/21 21:23:26\tINFO\ttorchdistill.misc.log\tEpoch: [146]  [  0/352]  eta: 0:03:41  lr: 0.0010000000000000002  img/s: 1154.424556235284  loss: 0.0009 (0.0009)  time: 0.6285  data: 0.5176  max mem: 281\n",
            "2021/05/21 21:23:30\tINFO\ttorchdistill.misc.log\tEpoch: [146]  [100/352]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 5113.884266976558  loss: 0.0009 (0.0011)  time: 0.0307  data: 0.0034  max mem: 281\n",
            "2021/05/21 21:23:33\tINFO\ttorchdistill.misc.log\tEpoch: [146]  [200/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 3787.288806117554  loss: 0.0009 (0.0011)  time: 0.0310  data: 0.0046  max mem: 281\n",
            "2021/05/21 21:23:36\tINFO\ttorchdistill.misc.log\tEpoch: [146]  [300/352]  eta: 0:00:01  lr: 0.0010000000000000002  img/s: 4134.3876785645525  loss: 0.0009 (0.0011)  time: 0.0316  data: 0.0029  max mem: 281\n",
            "2021/05/21 21:23:38\tINFO\ttorchdistill.misc.log\tEpoch: [146] Total time: 0:00:12\n",
            "2021/05/21 21:23:38\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:19  acc1: 75.7812 (75.7812)  acc5: 99.2188 (99.2188)  time: 0.4995  data: 0.4676  max mem: 281\n",
            "2021/05/21 21:23:39\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:23:39\tINFO\t__main__\t * Acc@1 84.9600\tAcc@5 98.9800\n",
            "\n",
            "2021/05/21 21:23:40\tINFO\ttorchdistill.misc.log\tEpoch: [147]  [  0/352]  eta: 0:03:44  lr: 0.0010000000000000002  img/s: 1030.903653579171  loss: 0.0005 (0.0005)  time: 0.6384  data: 0.5142  max mem: 281\n",
            "2021/05/21 21:23:43\tINFO\ttorchdistill.misc.log\tEpoch: [147]  [100/352]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 5357.191159008133  loss: 0.0010 (0.0011)  time: 0.0318  data: 0.0033  max mem: 281\n",
            "2021/05/21 21:23:46\tINFO\ttorchdistill.misc.log\tEpoch: [147]  [200/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 4811.1023568420105  loss: 0.0009 (0.0011)  time: 0.0312  data: 0.0032  max mem: 281\n",
            "2021/05/21 21:23:50\tINFO\ttorchdistill.misc.log\tEpoch: [147]  [300/352]  eta: 0:00:01  lr: 0.0010000000000000002  img/s: 5316.290495712277  loss: 0.0012 (0.0011)  time: 0.0301  data: 0.0041  max mem: 281\n",
            "2021/05/21 21:23:51\tINFO\ttorchdistill.misc.log\tEpoch: [147] Total time: 0:00:12\n",
            "2021/05/21 21:23:52\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 77.3438 (77.3438)  acc5: 99.2188 (99.2188)  time: 0.5686  data: 0.5305  max mem: 281\n",
            "2021/05/21 21:23:53\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:23:53\tINFO\t__main__\t * Acc@1 85.0600\tAcc@5 99.0400\n",
            "\n",
            "2021/05/21 21:23:54\tINFO\ttorchdistill.misc.log\tEpoch: [148]  [  0/352]  eta: 0:04:24  lr: 0.0010000000000000002  img/s: 809.8394442894099  loss: 0.0012 (0.0012)  time: 0.7509  data: 0.5928  max mem: 281\n",
            "2021/05/21 21:23:57\tINFO\ttorchdistill.misc.log\tEpoch: [148]  [100/352]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 4818.615925899332  loss: 0.0010 (0.0011)  time: 0.0309  data: 0.0040  max mem: 281\n",
            "2021/05/21 21:24:00\tINFO\ttorchdistill.misc.log\tEpoch: [148]  [200/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 5170.62256936753  loss: 0.0010 (0.0011)  time: 0.0324  data: 0.0038  max mem: 281\n",
            "2021/05/21 21:24:03\tINFO\ttorchdistill.misc.log\tEpoch: [148]  [300/352]  eta: 0:00:01  lr: 0.0010000000000000002  img/s: 3911.4852792248007  loss: 0.0011 (0.0012)  time: 0.0315  data: 0.0034  max mem: 281\n",
            "2021/05/21 21:24:05\tINFO\ttorchdistill.misc.log\tEpoch: [148] Total time: 0:00:12\n",
            "2021/05/21 21:24:06\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 75.7812 (75.7812)  acc5: 99.2188 (99.2188)  time: 0.5498  data: 0.5230  max mem: 281\n",
            "2021/05/21 21:24:07\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:24:07\tINFO\t__main__\t * Acc@1 84.9800\tAcc@5 99.1000\n",
            "\n",
            "2021/05/21 21:24:07\tINFO\ttorchdistill.misc.log\tEpoch: [149]  [  0/352]  eta: 0:04:04  lr: 0.0010000000000000002  img/s: 798.6809105068901  loss: 0.0011 (0.0011)  time: 0.6957  data: 0.5354  max mem: 281\n",
            "2021/05/21 21:24:11\tINFO\ttorchdistill.misc.log\tEpoch: [149]  [100/352]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 3850.2758378335734  loss: 0.0010 (0.0011)  time: 0.0313  data: 0.0042  max mem: 281\n",
            "2021/05/21 21:24:14\tINFO\ttorchdistill.misc.log\tEpoch: [149]  [200/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 5178.402816493851  loss: 0.0009 (0.0012)  time: 0.0300  data: 0.0028  max mem: 281\n",
            "2021/05/21 21:24:17\tINFO\ttorchdistill.misc.log\tEpoch: [149]  [300/352]  eta: 0:00:01  lr: 0.0010000000000000002  img/s: 4554.385069562267  loss: 0.0009 (0.0012)  time: 0.0311  data: 0.0025  max mem: 281\n",
            "2021/05/21 21:24:19\tINFO\ttorchdistill.misc.log\tEpoch: [149] Total time: 0:00:12\n",
            "2021/05/21 21:24:19\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 77.3438 (77.3438)  acc5: 99.2188 (99.2188)  time: 0.5387  data: 0.5046  max mem: 281\n",
            "2021/05/21 21:24:20\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:24:20\tINFO\t__main__\t * Acc@1 85.1400\tAcc@5 99.0600\n",
            "\n",
            "2021/05/21 21:24:21\tINFO\ttorchdistill.misc.log\tEpoch: [150]  [  0/352]  eta: 0:03:46  lr: 0.0010000000000000002  img/s: 1120.3389621121694  loss: 0.0012 (0.0012)  time: 0.6425  data: 0.5282  max mem: 281\n",
            "2021/05/21 21:24:25\tINFO\ttorchdistill.misc.log\tEpoch: [150]  [100/352]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 3874.785550864278  loss: 0.0010 (0.0011)  time: 0.0307  data: 0.0021  max mem: 281\n",
            "2021/05/21 21:24:28\tINFO\ttorchdistill.misc.log\tEpoch: [150]  [200/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 4852.587873748147  loss: 0.0010 (0.0011)  time: 0.0317  data: 0.0043  max mem: 281\n",
            "2021/05/21 21:24:31\tINFO\ttorchdistill.misc.log\tEpoch: [150]  [300/352]  eta: 0:00:01  lr: 0.0010000000000000002  img/s: 3786.64770771618  loss: 0.0009 (0.0011)  time: 0.0332  data: 0.0034  max mem: 281\n",
            "2021/05/21 21:24:33\tINFO\ttorchdistill.misc.log\tEpoch: [150] Total time: 0:00:12\n",
            "2021/05/21 21:24:33\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 76.5625 (76.5625)  acc5: 99.2188 (99.2188)  time: 0.5840  data: 0.5465  max mem: 281\n",
            "2021/05/21 21:24:34\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:24:34\tINFO\t__main__\t * Acc@1 84.9200\tAcc@5 98.9800\n",
            "\n",
            "2021/05/21 21:24:35\tINFO\ttorchdistill.misc.log\tEpoch: [151]  [  0/352]  eta: 0:03:56  lr: 0.0010000000000000002  img/s: 1283.1829441430245  loss: 0.0011 (0.0011)  time: 0.6721  data: 0.5723  max mem: 281\n",
            "2021/05/21 21:24:38\tINFO\ttorchdistill.misc.log\tEpoch: [151]  [100/352]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 5277.773089665071  loss: 0.0010 (0.0011)  time: 0.0309  data: 0.0040  max mem: 281\n",
            "2021/05/21 21:24:42\tINFO\ttorchdistill.misc.log\tEpoch: [151]  [200/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 5232.4559666289815  loss: 0.0011 (0.0011)  time: 0.0304  data: 0.0033  max mem: 281\n",
            "2021/05/21 21:24:45\tINFO\ttorchdistill.misc.log\tEpoch: [151]  [300/352]  eta: 0:00:01  lr: 0.0010000000000000002  img/s: 4965.326033073138  loss: 0.0009 (0.0011)  time: 0.0318  data: 0.0055  max mem: 281\n",
            "2021/05/21 21:24:46\tINFO\ttorchdistill.misc.log\tEpoch: [151] Total time: 0:00:12\n",
            "2021/05/21 21:24:47\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 77.3438 (77.3438)  acc5: 99.2188 (99.2188)  time: 0.5766  data: 0.5251  max mem: 281\n",
            "2021/05/21 21:24:48\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:24:48\tINFO\t__main__\t * Acc@1 85.1600\tAcc@5 99.0000\n",
            "\n",
            "2021/05/21 21:24:49\tINFO\ttorchdistill.misc.log\tEpoch: [152]  [  0/352]  eta: 0:03:42  lr: 0.0010000000000000002  img/s: 950.8467794496869  loss: 0.0009 (0.0009)  time: 0.6332  data: 0.4986  max mem: 281\n",
            "2021/05/21 21:24:52\tINFO\ttorchdistill.misc.log\tEpoch: [152]  [100/352]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 5063.625673190285  loss: 0.0011 (0.0011)  time: 0.0311  data: 0.0032  max mem: 281\n",
            "2021/05/21 21:24:56\tINFO\ttorchdistill.misc.log\tEpoch: [152]  [200/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 3495.662981338959  loss: 0.0012 (0.0011)  time: 0.0329  data: 0.0043  max mem: 281\n",
            "2021/05/21 21:24:59\tINFO\ttorchdistill.misc.log\tEpoch: [152]  [300/352]  eta: 0:00:01  lr: 0.0010000000000000002  img/s: 4741.712478913295  loss: 0.0010 (0.0011)  time: 0.0316  data: 0.0034  max mem: 281\n",
            "2021/05/21 21:25:00\tINFO\ttorchdistill.misc.log\tEpoch: [152] Total time: 0:00:12\n",
            "2021/05/21 21:25:01\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 78.1250 (78.1250)  acc5: 99.2188 (99.2188)  time: 0.5519  data: 0.5099  max mem: 281\n",
            "2021/05/21 21:25:02\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:25:02\tINFO\t__main__\t * Acc@1 85.2000\tAcc@5 99.1000\n",
            "\n",
            "2021/05/21 21:25:03\tINFO\ttorchdistill.misc.log\tEpoch: [153]  [  0/352]  eta: 0:04:11  lr: 0.0010000000000000002  img/s: 1081.1542173139042  loss: 0.0005 (0.0005)  time: 0.7147  data: 0.5963  max mem: 281\n",
            "2021/05/21 21:25:06\tINFO\ttorchdistill.misc.log\tEpoch: [153]  [100/352]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 4956.524539310905  loss: 0.0011 (0.0012)  time: 0.0325  data: 0.0042  max mem: 281\n",
            "2021/05/21 21:25:09\tINFO\ttorchdistill.misc.log\tEpoch: [153]  [200/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 3850.4967546206312  loss: 0.0010 (0.0012)  time: 0.0309  data: 0.0031  max mem: 281\n",
            "2021/05/21 21:25:13\tINFO\ttorchdistill.misc.log\tEpoch: [153]  [300/352]  eta: 0:00:01  lr: 0.0010000000000000002  img/s: 3999.574706478336  loss: 0.0010 (0.0012)  time: 0.0315  data: 0.0050  max mem: 281\n",
            "2021/05/21 21:25:14\tINFO\ttorchdistill.misc.log\tEpoch: [153] Total time: 0:00:12\n",
            "2021/05/21 21:25:15\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 77.3438 (77.3438)  acc5: 100.0000 (100.0000)  time: 0.5482  data: 0.5085  max mem: 281\n",
            "2021/05/21 21:25:16\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:25:16\tINFO\t__main__\t * Acc@1 84.8200\tAcc@5 99.0800\n",
            "\n",
            "2021/05/21 21:25:16\tINFO\ttorchdistill.misc.log\tEpoch: [154]  [  0/352]  eta: 0:03:46  lr: 0.0010000000000000002  img/s: 1024.7779342991848  loss: 0.0018 (0.0018)  time: 0.6441  data: 0.5192  max mem: 281\n",
            "2021/05/21 21:25:20\tINFO\ttorchdistill.misc.log\tEpoch: [154]  [100/352]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 5453.178860549919  loss: 0.0010 (0.0011)  time: 0.0319  data: 0.0022  max mem: 281\n",
            "2021/05/21 21:25:23\tINFO\ttorchdistill.misc.log\tEpoch: [154]  [200/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 5170.224212482786  loss: 0.0010 (0.0012)  time: 0.0311  data: 0.0039  max mem: 281\n",
            "2021/05/21 21:25:26\tINFO\ttorchdistill.misc.log\tEpoch: [154]  [300/352]  eta: 0:00:01  lr: 0.0010000000000000002  img/s: 4834.932564841499  loss: 0.0011 (0.0012)  time: 0.0312  data: 0.0041  max mem: 281\n",
            "2021/05/21 21:25:28\tINFO\ttorchdistill.misc.log\tEpoch: [154] Total time: 0:00:12\n",
            "2021/05/21 21:25:29\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 77.3438 (77.3438)  acc5: 99.2188 (99.2188)  time: 0.5328  data: 0.5131  max mem: 281\n",
            "2021/05/21 21:25:30\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:25:30\tINFO\t__main__\t * Acc@1 85.0200\tAcc@5 99.0200\n",
            "\n",
            "2021/05/21 21:25:30\tINFO\ttorchdistill.misc.log\tEpoch: [155]  [  0/352]  eta: 0:03:33  lr: 0.0010000000000000002  img/s: 1201.5561588404992  loss: 0.0015 (0.0015)  time: 0.6064  data: 0.4998  max mem: 281\n",
            "2021/05/21 21:25:34\tINFO\ttorchdistill.misc.log\tEpoch: [155]  [100/352]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 3863.7148943520065  loss: 0.0010 (0.0011)  time: 0.0315  data: 0.0024  max mem: 281\n",
            "2021/05/21 21:25:37\tINFO\ttorchdistill.misc.log\tEpoch: [155]  [200/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 4265.314827320468  loss: 0.0010 (0.0011)  time: 0.0306  data: 0.0039  max mem: 281\n",
            "2021/05/21 21:25:40\tINFO\ttorchdistill.misc.log\tEpoch: [155]  [300/352]  eta: 0:00:01  lr: 0.0010000000000000002  img/s: 5431.607130572024  loss: 0.0010 (0.0011)  time: 0.0318  data: 0.0036  max mem: 281\n",
            "2021/05/21 21:25:42\tINFO\ttorchdistill.misc.log\tEpoch: [155] Total time: 0:00:12\n",
            "2021/05/21 21:25:42\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 76.5625 (76.5625)  acc5: 99.2188 (99.2188)  time: 0.5952  data: 0.5562  max mem: 281\n",
            "2021/05/21 21:25:44\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:25:44\tINFO\t__main__\t * Acc@1 84.9800\tAcc@5 99.0200\n",
            "\n",
            "2021/05/21 21:25:44\tINFO\ttorchdistill.misc.log\tEpoch: [156]  [  0/352]  eta: 0:03:38  lr: 0.0010000000000000002  img/s: 1014.4742116093581  loss: 0.0006 (0.0006)  time: 0.6219  data: 0.4957  max mem: 281\n",
            "2021/05/21 21:25:48\tINFO\ttorchdistill.misc.log\tEpoch: [156]  [100/352]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 5074.921891690063  loss: 0.0013 (0.0011)  time: 0.0308  data: 0.0023  max mem: 281\n",
            "2021/05/21 21:25:51\tINFO\ttorchdistill.misc.log\tEpoch: [156]  [200/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 5413.696941584568  loss: 0.0010 (0.0011)  time: 0.0308  data: 0.0039  max mem: 281\n",
            "2021/05/21 21:25:54\tINFO\ttorchdistill.misc.log\tEpoch: [156]  [300/352]  eta: 0:00:01  lr: 0.0010000000000000002  img/s: 4281.096543200032  loss: 0.0011 (0.0011)  time: 0.0308  data: 0.0031  max mem: 281\n",
            "2021/05/21 21:25:56\tINFO\ttorchdistill.misc.log\tEpoch: [156] Total time: 0:00:12\n",
            "2021/05/21 21:25:56\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 78.1250 (78.1250)  acc5: 99.2188 (99.2188)  time: 0.5768  data: 0.5262  max mem: 281\n",
            "2021/05/21 21:25:57\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:25:57\tINFO\t__main__\t * Acc@1 85.0600\tAcc@5 99.0000\n",
            "\n",
            "2021/05/21 21:25:58\tINFO\ttorchdistill.misc.log\tEpoch: [157]  [  0/352]  eta: 0:04:40  lr: 0.0010000000000000002  img/s: 1018.0793534305387  loss: 0.0009 (0.0009)  time: 0.7969  data: 0.6711  max mem: 281\n",
            "2021/05/21 21:26:02\tINFO\ttorchdistill.misc.log\tEpoch: [157]  [100/352]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 4980.388248281492  loss: 0.0010 (0.0011)  time: 0.0312  data: 0.0035  max mem: 281\n",
            "2021/05/21 21:26:05\tINFO\ttorchdistill.misc.log\tEpoch: [157]  [200/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 5395.416431335108  loss: 0.0011 (0.0011)  time: 0.0313  data: 0.0039  max mem: 281\n",
            "2021/05/21 21:26:08\tINFO\ttorchdistill.misc.log\tEpoch: [157]  [300/352]  eta: 0:00:01  lr: 0.0010000000000000002  img/s: 4565.267663840679  loss: 0.0009 (0.0011)  time: 0.0335  data: 0.0028  max mem: 281\n",
            "2021/05/21 21:26:10\tINFO\ttorchdistill.misc.log\tEpoch: [157] Total time: 0:00:12\n",
            "2021/05/21 21:26:10\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 77.3438 (77.3438)  acc5: 99.2188 (99.2188)  time: 0.5844  data: 0.5334  max mem: 281\n",
            "2021/05/21 21:26:11\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:26:11\tINFO\t__main__\t * Acc@1 84.9400\tAcc@5 99.0000\n",
            "\n",
            "2021/05/21 21:26:12\tINFO\ttorchdistill.misc.log\tEpoch: [158]  [  0/352]  eta: 0:04:32  lr: 0.0010000000000000002  img/s: 998.0460215421567  loss: 0.0009 (0.0009)  time: 0.7730  data: 0.6448  max mem: 281\n",
            "2021/05/21 21:26:16\tINFO\ttorchdistill.misc.log\tEpoch: [158]  [100/352]  eta: 0:00:11  lr: 0.0010000000000000002  img/s: 5140.275286277814  loss: 0.0010 (0.0011)  time: 0.0325  data: 0.0029  max mem: 281\n",
            "2021/05/21 21:26:19\tINFO\ttorchdistill.misc.log\tEpoch: [158]  [200/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 4426.706068601583  loss: 0.0009 (0.0011)  time: 0.0329  data: 0.0057  max mem: 281\n",
            "2021/05/21 21:26:23\tINFO\ttorchdistill.misc.log\tEpoch: [158]  [300/352]  eta: 0:00:01  lr: 0.0010000000000000002  img/s: 4404.263498990959  loss: 0.0010 (0.0011)  time: 0.0334  data: 0.0036  max mem: 281\n",
            "2021/05/21 21:26:24\tINFO\ttorchdistill.misc.log\tEpoch: [158] Total time: 0:00:12\n",
            "2021/05/21 21:26:25\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:25  acc1: 76.5625 (76.5625)  acc5: 99.2188 (99.2188)  time: 0.6465  data: 0.6037  max mem: 281\n",
            "2021/05/21 21:26:26\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:26:26\tINFO\t__main__\t * Acc@1 85.2200\tAcc@5 99.0600\n",
            "\n",
            "2021/05/21 21:26:27\tINFO\ttorchdistill.misc.log\tEpoch: [159]  [  0/352]  eta: 0:03:48  lr: 0.0010000000000000002  img/s: 1278.2488589421555  loss: 0.0007 (0.0007)  time: 0.6492  data: 0.5490  max mem: 281\n",
            "2021/05/21 21:26:31\tINFO\ttorchdistill.misc.log\tEpoch: [159]  [100/352]  eta: 0:00:11  lr: 0.0010000000000000002  img/s: 5189.214200794518  loss: 0.0010 (0.0012)  time: 0.0328  data: 0.0040  max mem: 281\n",
            "2021/05/21 21:26:34\tINFO\ttorchdistill.misc.log\tEpoch: [159]  [200/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 5211.276458197844  loss: 0.0009 (0.0011)  time: 0.0323  data: 0.0044  max mem: 281\n",
            "2021/05/21 21:26:37\tINFO\ttorchdistill.misc.log\tEpoch: [159]  [300/352]  eta: 0:00:01  lr: 0.0010000000000000002  img/s: 3827.519940684129  loss: 0.0010 (0.0011)  time: 0.0321  data: 0.0035  max mem: 281\n",
            "2021/05/21 21:26:39\tINFO\ttorchdistill.misc.log\tEpoch: [159] Total time: 0:00:12\n",
            "2021/05/21 21:26:39\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 78.9062 (78.9062)  acc5: 99.2188 (99.2188)  time: 0.5576  data: 0.5430  max mem: 281\n",
            "2021/05/21 21:26:40\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:26:40\tINFO\t__main__\t * Acc@1 85.0800\tAcc@5 98.9800\n",
            "\n",
            "2021/05/21 21:26:41\tINFO\ttorchdistill.misc.log\tEpoch: [160]  [  0/352]  eta: 0:03:41  lr: 0.0010000000000000002  img/s: 1253.030430053821  loss: 0.0018 (0.0018)  time: 0.6287  data: 0.5266  max mem: 281\n",
            "2021/05/21 21:26:45\tINFO\ttorchdistill.misc.log\tEpoch: [160]  [100/352]  eta: 0:00:11  lr: 0.0010000000000000002  img/s: 4727.807531085984  loss: 0.0009 (0.0011)  time: 0.0328  data: 0.0034  max mem: 281\n",
            "2021/05/21 21:26:48\tINFO\ttorchdistill.misc.log\tEpoch: [160]  [200/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 5077.321631564512  loss: 0.0010 (0.0011)  time: 0.0325  data: 0.0031  max mem: 281\n",
            "2021/05/21 21:26:51\tINFO\ttorchdistill.misc.log\tEpoch: [160]  [300/352]  eta: 0:00:01  lr: 0.0010000000000000002  img/s: 5039.432594289147  loss: 0.0011 (0.0012)  time: 0.0314  data: 0.0022  max mem: 281\n",
            "2021/05/21 21:26:53\tINFO\ttorchdistill.misc.log\tEpoch: [160] Total time: 0:00:12\n",
            "2021/05/21 21:26:54\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 78.1250 (78.1250)  acc5: 99.2188 (99.2188)  time: 0.5534  data: 0.5312  max mem: 281\n",
            "2021/05/21 21:26:55\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:26:55\tINFO\t__main__\t * Acc@1 85.0000\tAcc@5 99.0200\n",
            "\n",
            "2021/05/21 21:26:55\tINFO\ttorchdistill.misc.log\tEpoch: [161]  [  0/352]  eta: 0:03:53  lr: 0.0010000000000000002  img/s: 1085.5416618644667  loss: 0.0007 (0.0007)  time: 0.6631  data: 0.5452  max mem: 281\n",
            "2021/05/21 21:26:59\tINFO\ttorchdistill.misc.log\tEpoch: [161]  [100/352]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 5179.951680753348  loss: 0.0009 (0.0011)  time: 0.0323  data: 0.0055  max mem: 281\n",
            "2021/05/21 21:27:02\tINFO\ttorchdistill.misc.log\tEpoch: [161]  [200/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 4176.748603525805  loss: 0.0009 (0.0011)  time: 0.0316  data: 0.0034  max mem: 281\n",
            "2021/05/21 21:27:05\tINFO\ttorchdistill.misc.log\tEpoch: [161]  [300/352]  eta: 0:00:01  lr: 0.0010000000000000002  img/s: 5277.773089665071  loss: 0.0010 (0.0011)  time: 0.0311  data: 0.0052  max mem: 281\n",
            "2021/05/21 21:27:07\tINFO\ttorchdistill.misc.log\tEpoch: [161] Total time: 0:00:12\n",
            "2021/05/21 21:27:08\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 77.3438 (77.3438)  acc5: 99.2188 (99.2188)  time: 0.5499  data: 0.5039  max mem: 281\n",
            "2021/05/21 21:27:09\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:27:09\tINFO\t__main__\t * Acc@1 85.2800\tAcc@5 99.1000\n",
            "\n",
            "2021/05/21 21:27:09\tINFO\ttorchdistill.misc.log\tEpoch: [162]  [  0/352]  eta: 0:03:55  lr: 0.0010000000000000002  img/s: 1016.0485549526771  loss: 0.0012 (0.0012)  time: 0.6693  data: 0.5433  max mem: 281\n",
            "2021/05/21 21:27:13\tINFO\ttorchdistill.misc.log\tEpoch: [162]  [100/352]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 4838.46206256365  loss: 0.0011 (0.0012)  time: 0.0310  data: 0.0033  max mem: 281\n",
            "2021/05/21 21:27:16\tINFO\ttorchdistill.misc.log\tEpoch: [162]  [200/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 3869.0889383751683  loss: 0.0011 (0.0012)  time: 0.0313  data: 0.0032  max mem: 281\n",
            "2021/05/21 21:27:19\tINFO\ttorchdistill.misc.log\tEpoch: [162]  [300/352]  eta: 0:00:01  lr: 0.0010000000000000002  img/s: 3325.5135777998016  loss: 0.0010 (0.0012)  time: 0.0321  data: 0.0038  max mem: 281\n",
            "2021/05/21 21:27:21\tINFO\ttorchdistill.misc.log\tEpoch: [162] Total time: 0:00:12\n",
            "2021/05/21 21:27:21\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 78.9062 (78.9062)  acc5: 100.0000 (100.0000)  time: 0.5653  data: 0.5304  max mem: 281\n",
            "2021/05/21 21:27:22\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:27:22\tINFO\t__main__\t * Acc@1 85.1400\tAcc@5 99.0400\n",
            "\n",
            "2021/05/21 21:27:23\tINFO\ttorchdistill.misc.log\tEpoch: [163]  [  0/352]  eta: 0:03:51  lr: 0.0010000000000000002  img/s: 998.4395157240892  loss: 0.0010 (0.0010)  time: 0.6570  data: 0.5288  max mem: 281\n",
            "2021/05/21 21:27:27\tINFO\ttorchdistill.misc.log\tEpoch: [163]  [100/352]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 4759.325130314528  loss: 0.0010 (0.0011)  time: 0.0315  data: 0.0046  max mem: 281\n",
            "2021/05/21 21:27:30\tINFO\ttorchdistill.misc.log\tEpoch: [163]  [200/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 5388.647114322995  loss: 0.0010 (0.0011)  time: 0.0306  data: 0.0021  max mem: 281\n",
            "2021/05/21 21:27:33\tINFO\ttorchdistill.misc.log\tEpoch: [163]  [300/352]  eta: 0:00:01  lr: 0.0010000000000000002  img/s: 5054.710503521259  loss: 0.0010 (0.0011)  time: 0.0315  data: 0.0048  max mem: 281\n",
            "2021/05/21 21:27:34\tINFO\ttorchdistill.misc.log\tEpoch: [163] Total time: 0:00:12\n",
            "2021/05/21 21:27:35\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:24  acc1: 77.3438 (77.3438)  acc5: 99.2188 (99.2188)  time: 0.6006  data: 0.5719  max mem: 281\n",
            "2021/05/21 21:27:36\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:27:36\tINFO\t__main__\t * Acc@1 85.0000\tAcc@5 98.9600\n",
            "\n",
            "2021/05/21 21:27:37\tINFO\ttorchdistill.misc.log\tEpoch: [164]  [  0/352]  eta: 0:04:47  lr: 0.0010000000000000002  img/s: 1023.295407024506  loss: 0.0006 (0.0006)  time: 0.8156  data: 0.6905  max mem: 281\n",
            "2021/05/21 21:27:40\tINFO\ttorchdistill.misc.log\tEpoch: [164]  [100/352]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 4768.75238272888  loss: 0.0009 (0.0011)  time: 0.0323  data: 0.0035  max mem: 281\n",
            "2021/05/21 21:27:44\tINFO\ttorchdistill.misc.log\tEpoch: [164]  [200/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 5330.648291200826  loss: 0.0009 (0.0011)  time: 0.0316  data: 0.0044  max mem: 281\n",
            "2021/05/21 21:27:47\tINFO\ttorchdistill.misc.log\tEpoch: [164]  [300/352]  eta: 0:00:01  lr: 0.0010000000000000002  img/s: 4894.21497789325  loss: 0.0011 (0.0011)  time: 0.0313  data: 0.0044  max mem: 281\n",
            "2021/05/21 21:27:48\tINFO\ttorchdistill.misc.log\tEpoch: [164] Total time: 0:00:12\n",
            "2021/05/21 21:27:49\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 77.3438 (77.3438)  acc5: 99.2188 (99.2188)  time: 0.5777  data: 0.5396  max mem: 281\n",
            "2021/05/21 21:27:50\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:27:50\tINFO\t__main__\t * Acc@1 84.9800\tAcc@5 98.9800\n",
            "\n",
            "2021/05/21 21:27:51\tINFO\ttorchdistill.misc.log\tEpoch: [165]  [  0/352]  eta: 0:04:08  lr: 0.0010000000000000002  img/s: 803.9878279621421  loss: 0.0010 (0.0010)  time: 0.7050  data: 0.5458  max mem: 281\n",
            "2021/05/21 21:27:54\tINFO\ttorchdistill.misc.log\tEpoch: [165]  [100/352]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 3501.293977239378  loss: 0.0010 (0.0012)  time: 0.0324  data: 0.0030  max mem: 281\n",
            "2021/05/21 21:27:57\tINFO\ttorchdistill.misc.log\tEpoch: [165]  [200/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 5387.511535258051  loss: 0.0010 (0.0011)  time: 0.0317  data: 0.0031  max mem: 281\n",
            "2021/05/21 21:28:01\tINFO\ttorchdistill.misc.log\tEpoch: [165]  [300/352]  eta: 0:00:01  lr: 0.0010000000000000002  img/s: 5173.612203794894  loss: 0.0011 (0.0012)  time: 0.0313  data: 0.0039  max mem: 281\n",
            "2021/05/21 21:28:02\tINFO\ttorchdistill.misc.log\tEpoch: [165] Total time: 0:00:12\n",
            "2021/05/21 21:28:03\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 76.5625 (76.5625)  acc5: 99.2188 (99.2188)  time: 0.5804  data: 0.5547  max mem: 281\n",
            "2021/05/21 21:28:04\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:28:04\tINFO\t__main__\t * Acc@1 85.0200\tAcc@5 99.0600\n",
            "\n",
            "2021/05/21 21:28:04\tINFO\ttorchdistill.misc.log\tEpoch: [166]  [  0/352]  eta: 0:03:38  lr: 0.0010000000000000002  img/s: 1105.7146693797858  loss: 0.0008 (0.0008)  time: 0.6216  data: 0.5058  max mem: 281\n",
            "2021/05/21 21:28:08\tINFO\ttorchdistill.misc.log\tEpoch: [166]  [100/352]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 5012.098324230967  loss: 0.0009 (0.0011)  time: 0.0327  data: 0.0044  max mem: 281\n",
            "2021/05/21 21:28:11\tINFO\ttorchdistill.misc.log\tEpoch: [166]  [200/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 3825.4744657655283  loss: 0.0010 (0.0011)  time: 0.0326  data: 0.0026  max mem: 281\n",
            "2021/05/21 21:28:14\tINFO\ttorchdistill.misc.log\tEpoch: [166]  [300/352]  eta: 0:00:01  lr: 0.0010000000000000002  img/s: 3205.7736430405444  loss: 0.0010 (0.0011)  time: 0.0314  data: 0.0033  max mem: 281\n",
            "2021/05/21 21:28:16\tINFO\ttorchdistill.misc.log\tEpoch: [166] Total time: 0:00:12\n",
            "2021/05/21 21:28:17\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 78.1250 (78.1250)  acc5: 99.2188 (99.2188)  time: 0.5557  data: 0.5275  max mem: 281\n",
            "2021/05/21 21:28:18\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:28:18\tINFO\t__main__\t * Acc@1 85.1200\tAcc@5 99.0600\n",
            "\n",
            "2021/05/21 21:28:18\tINFO\ttorchdistill.misc.log\tEpoch: [167]  [  0/352]  eta: 0:03:53  lr: 0.0010000000000000002  img/s: 861.4897117888795  loss: 0.0008 (0.0008)  time: 0.6637  data: 0.5151  max mem: 281\n",
            "2021/05/21 21:28:22\tINFO\ttorchdistill.misc.log\tEpoch: [167]  [100/352]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 5236.079233027415  loss: 0.0010 (0.0012)  time: 0.0311  data: 0.0045  max mem: 281\n",
            "2021/05/21 21:28:25\tINFO\ttorchdistill.misc.log\tEpoch: [167]  [200/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 5191.622864105366  loss: 0.0010 (0.0011)  time: 0.0323  data: 0.0044  max mem: 281\n",
            "2021/05/21 21:28:28\tINFO\ttorchdistill.misc.log\tEpoch: [167]  [300/352]  eta: 0:00:01  lr: 0.0010000000000000002  img/s: 5042.367119993989  loss: 0.0009 (0.0011)  time: 0.0317  data: 0.0046  max mem: 281\n",
            "2021/05/21 21:28:30\tINFO\ttorchdistill.misc.log\tEpoch: [167] Total time: 0:00:12\n",
            "2021/05/21 21:28:30\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 77.3438 (77.3438)  acc5: 99.2188 (99.2188)  time: 0.5589  data: 0.5230  max mem: 281\n",
            "2021/05/21 21:28:31\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:28:31\tINFO\t__main__\t * Acc@1 85.2400\tAcc@5 99.0400\n",
            "\n",
            "2021/05/21 21:28:32\tINFO\ttorchdistill.misc.log\tEpoch: [168]  [  0/352]  eta: 0:03:36  lr: 0.0010000000000000002  img/s: 1083.0451821143624  loss: 0.0010 (0.0010)  time: 0.6142  data: 0.4960  max mem: 281\n",
            "2021/05/21 21:28:36\tINFO\ttorchdistill.misc.log\tEpoch: [168]  [100/352]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 5281.875093463461  loss: 0.0010 (0.0011)  time: 0.0309  data: 0.0025  max mem: 281\n",
            "2021/05/21 21:28:39\tINFO\ttorchdistill.misc.log\tEpoch: [168]  [200/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 3325.884402373902  loss: 0.0009 (0.0011)  time: 0.0322  data: 0.0036  max mem: 281\n",
            "2021/05/21 21:28:42\tINFO\ttorchdistill.misc.log\tEpoch: [168]  [300/352]  eta: 0:00:01  lr: 0.0010000000000000002  img/s: 4941.060346969767  loss: 0.0009 (0.0011)  time: 0.0316  data: 0.0034  max mem: 281\n",
            "2021/05/21 21:28:44\tINFO\ttorchdistill.misc.log\tEpoch: [168] Total time: 0:00:12\n",
            "2021/05/21 21:28:44\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 78.1250 (78.1250)  acc5: 99.2188 (99.2188)  time: 0.5677  data: 0.5235  max mem: 281\n",
            "2021/05/21 21:28:45\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:28:45\tINFO\t__main__\t * Acc@1 85.1800\tAcc@5 99.0200\n",
            "\n",
            "2021/05/21 21:28:46\tINFO\ttorchdistill.misc.log\tEpoch: [169]  [  0/352]  eta: 0:04:00  lr: 0.0010000000000000002  img/s: 1093.180764351702  loss: 0.0009 (0.0009)  time: 0.6827  data: 0.5656  max mem: 281\n",
            "2021/05/21 21:28:49\tINFO\ttorchdistill.misc.log\tEpoch: [169]  [100/352]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 4743.304430799134  loss: 0.0009 (0.0011)  time: 0.0322  data: 0.0043  max mem: 281\n",
            "2021/05/21 21:28:53\tINFO\ttorchdistill.misc.log\tEpoch: [169]  [200/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 5203.901557668634  loss: 0.0010 (0.0011)  time: 0.0321  data: 0.0027  max mem: 281\n",
            "2021/05/21 21:28:56\tINFO\ttorchdistill.misc.log\tEpoch: [169]  [300/352]  eta: 0:00:01  lr: 0.0010000000000000002  img/s: 4015.038791459447  loss: 0.0011 (0.0011)  time: 0.0309  data: 0.0030  max mem: 281\n",
            "2021/05/21 21:28:57\tINFO\ttorchdistill.misc.log\tEpoch: [169] Total time: 0:00:12\n",
            "2021/05/21 21:28:58\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:24  acc1: 77.3438 (77.3438)  acc5: 100.0000 (100.0000)  time: 0.6017  data: 0.5689  max mem: 281\n",
            "2021/05/21 21:28:59\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:28:59\tINFO\t__main__\t * Acc@1 85.1000\tAcc@5 99.0800\n",
            "\n",
            "2021/05/21 21:29:00\tINFO\ttorchdistill.misc.log\tEpoch: [170]  [  0/352]  eta: 0:04:07  lr: 0.0010000000000000002  img/s: 1106.7472401971597  loss: 0.0011 (0.0011)  time: 0.7030  data: 0.5873  max mem: 281\n",
            "2021/05/21 21:29:03\tINFO\ttorchdistill.misc.log\tEpoch: [170]  [100/352]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 5347.90576656805  loss: 0.0009 (0.0011)  time: 0.0313  data: 0.0041  max mem: 281\n",
            "2021/05/21 21:29:07\tINFO\ttorchdistill.misc.log\tEpoch: [170]  [200/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 5251.238905679939  loss: 0.0010 (0.0012)  time: 0.0311  data: 0.0036  max mem: 281\n",
            "2021/05/21 21:29:10\tINFO\ttorchdistill.misc.log\tEpoch: [170]  [300/352]  eta: 0:00:01  lr: 0.0010000000000000002  img/s: 4329.848555966869  loss: 0.0010 (0.0012)  time: 0.0314  data: 0.0029  max mem: 281\n",
            "2021/05/21 21:29:11\tINFO\ttorchdistill.misc.log\tEpoch: [170] Total time: 0:00:12\n",
            "2021/05/21 21:29:12\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 77.3438 (77.3438)  acc5: 99.2188 (99.2188)  time: 0.5647  data: 0.5249  max mem: 281\n",
            "2021/05/21 21:29:13\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:29:13\tINFO\t__main__\t * Acc@1 85.2600\tAcc@5 99.0800\n",
            "\n",
            "2021/05/21 21:29:14\tINFO\ttorchdistill.misc.log\tEpoch: [171]  [  0/352]  eta: 0:03:41  lr: 0.0010000000000000002  img/s: 1195.8660575267463  loss: 0.0008 (0.0008)  time: 0.6280  data: 0.5210  max mem: 281\n",
            "2021/05/21 21:29:17\tINFO\ttorchdistill.misc.log\tEpoch: [171]  [100/352]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 5366.079740926946  loss: 0.0010 (0.0011)  time: 0.0311  data: 0.0036  max mem: 281\n",
            "2021/05/21 21:29:20\tINFO\ttorchdistill.misc.log\tEpoch: [171]  [200/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 3671.364078997757  loss: 0.0010 (0.0011)  time: 0.0314  data: 0.0024  max mem: 281\n",
            "2021/05/21 21:29:24\tINFO\ttorchdistill.misc.log\tEpoch: [171]  [300/352]  eta: 0:00:01  lr: 0.0010000000000000002  img/s: 4937.243417725012  loss: 0.0010 (0.0011)  time: 0.0320  data: 0.0033  max mem: 281\n",
            "2021/05/21 21:29:25\tINFO\ttorchdistill.misc.log\tEpoch: [171] Total time: 0:00:12\n",
            "2021/05/21 21:29:26\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 76.5625 (76.5625)  acc5: 99.2188 (99.2188)  time: 0.5349  data: 0.4972  max mem: 281\n",
            "2021/05/21 21:29:27\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:29:27\tINFO\t__main__\t * Acc@1 85.2400\tAcc@5 99.0200\n",
            "\n",
            "2021/05/21 21:29:27\tINFO\ttorchdistill.misc.log\tEpoch: [172]  [  0/352]  eta: 0:03:42  lr: 0.0010000000000000002  img/s: 1034.0647591898842  loss: 0.0014 (0.0014)  time: 0.6328  data: 0.5090  max mem: 281\n",
            "2021/05/21 21:29:31\tINFO\ttorchdistill.misc.log\tEpoch: [172]  [100/352]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 3935.224786882362  loss: 0.0011 (0.0011)  time: 0.0326  data: 0.0047  max mem: 281\n",
            "2021/05/21 21:29:34\tINFO\ttorchdistill.misc.log\tEpoch: [172]  [200/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 2997.805056731886  loss: 0.0010 (0.0011)  time: 0.0318  data: 0.0038  max mem: 281\n",
            "2021/05/21 21:29:37\tINFO\ttorchdistill.misc.log\tEpoch: [172]  [300/352]  eta: 0:00:01  lr: 0.0010000000000000002  img/s: 5263.182314592422  loss: 0.0010 (0.0012)  time: 0.0328  data: 0.0045  max mem: 281\n",
            "2021/05/21 21:29:39\tINFO\ttorchdistill.misc.log\tEpoch: [172] Total time: 0:00:12\n",
            "2021/05/21 21:29:40\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 76.5625 (76.5625)  acc5: 99.2188 (99.2188)  time: 0.5736  data: 0.5407  max mem: 281\n",
            "2021/05/21 21:29:41\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:29:41\tINFO\t__main__\t * Acc@1 85.0600\tAcc@5 99.0200\n",
            "\n",
            "2021/05/21 21:29:41\tINFO\ttorchdistill.misc.log\tEpoch: [173]  [  0/352]  eta: 0:04:36  lr: 0.0010000000000000002  img/s: 1002.3504178397795  loss: 0.0024 (0.0024)  time: 0.7842  data: 0.6565  max mem: 281\n",
            "2021/05/21 21:29:45\tINFO\ttorchdistill.misc.log\tEpoch: [173]  [100/352]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 3275.580454054582  loss: 0.0009 (0.0011)  time: 0.0317  data: 0.0034  max mem: 281\n",
            "2021/05/21 21:29:48\tINFO\ttorchdistill.misc.log\tEpoch: [173]  [200/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 3928.917875386034  loss: 0.0010 (0.0011)  time: 0.0310  data: 0.0037  max mem: 281\n",
            "2021/05/21 21:29:51\tINFO\ttorchdistill.misc.log\tEpoch: [173]  [300/352]  eta: 0:00:01  lr: 0.0010000000000000002  img/s: 5390.919709201912  loss: 0.0009 (0.0011)  time: 0.0311  data: 0.0038  max mem: 281\n",
            "2021/05/21 21:29:53\tINFO\ttorchdistill.misc.log\tEpoch: [173] Total time: 0:00:12\n",
            "2021/05/21 21:29:53\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:24  acc1: 77.3438 (77.3438)  acc5: 99.2188 (99.2188)  time: 0.6077  data: 0.5418  max mem: 281\n",
            "2021/05/21 21:29:54\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:29:54\tINFO\t__main__\t * Acc@1 85.1000\tAcc@5 99.1400\n",
            "\n",
            "2021/05/21 21:29:55\tINFO\ttorchdistill.misc.log\tEpoch: [174]  [  0/352]  eta: 0:03:37  lr: 0.0010000000000000002  img/s: 1138.3669136901922  loss: 0.0008 (0.0008)  time: 0.6171  data: 0.5046  max mem: 281\n",
            "2021/05/21 21:29:59\tINFO\ttorchdistill.misc.log\tEpoch: [174]  [100/352]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 5117.101251465444  loss: 0.0011 (0.0011)  time: 0.0318  data: 0.0041  max mem: 281\n",
            "2021/05/21 21:30:02\tINFO\ttorchdistill.misc.log\tEpoch: [174]  [200/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 5162.418862263933  loss: 0.0010 (0.0011)  time: 0.0318  data: 0.0037  max mem: 281\n",
            "2021/05/21 21:30:05\tINFO\ttorchdistill.misc.log\tEpoch: [174]  [300/352]  eta: 0:00:01  lr: 0.0010000000000000002  img/s: 4990.0631297170685  loss: 0.0009 (0.0011)  time: 0.0316  data: 0.0038  max mem: 281\n",
            "2021/05/21 21:30:07\tINFO\ttorchdistill.misc.log\tEpoch: [174] Total time: 0:00:12\n",
            "2021/05/21 21:30:07\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:21  acc1: 78.1250 (78.1250)  acc5: 100.0000 (100.0000)  time: 0.5304  data: 0.5016  max mem: 281\n",
            "2021/05/21 21:30:08\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:30:08\tINFO\t__main__\t * Acc@1 85.1600\tAcc@5 99.0800\n",
            "\n",
            "2021/05/21 21:30:09\tINFO\ttorchdistill.misc.log\tEpoch: [175]  [  0/352]  eta: 0:04:35  lr: 0.0010000000000000002  img/s: 1215.5778824839979  loss: 0.0015 (0.0015)  time: 0.7818  data: 0.6765  max mem: 281\n",
            "2021/05/21 21:30:13\tINFO\ttorchdistill.misc.log\tEpoch: [175]  [100/352]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 5244.006642052003  loss: 0.0010 (0.0011)  time: 0.0318  data: 0.0037  max mem: 281\n",
            "2021/05/21 21:30:16\tINFO\ttorchdistill.misc.log\tEpoch: [175]  [200/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 4952.272523498971  loss: 0.0010 (0.0011)  time: 0.0310  data: 0.0036  max mem: 281\n",
            "2021/05/21 21:30:19\tINFO\ttorchdistill.misc.log\tEpoch: [175]  [300/352]  eta: 0:00:01  lr: 0.0010000000000000002  img/s: 3502.0933594259623  loss: 0.0010 (0.0011)  time: 0.0322  data: 0.0040  max mem: 281\n",
            "2021/05/21 21:30:21\tINFO\ttorchdistill.misc.log\tEpoch: [175] Total time: 0:00:12\n",
            "2021/05/21 21:30:21\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 77.3438 (77.3438)  acc5: 99.2188 (99.2188)  time: 0.5671  data: 0.5177  max mem: 281\n",
            "2021/05/21 21:30:22\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:30:22\tINFO\t__main__\t * Acc@1 85.2000\tAcc@5 99.0000\n",
            "\n",
            "2021/05/21 21:30:23\tINFO\ttorchdistill.misc.log\tEpoch: [176]  [  0/352]  eta: 0:03:59  lr: 0.0010000000000000002  img/s: 869.9379748742986  loss: 0.0008 (0.0008)  time: 0.6806  data: 0.5334  max mem: 281\n",
            "2021/05/21 21:30:27\tINFO\ttorchdistill.misc.log\tEpoch: [176]  [100/352]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 4437.939970075968  loss: 0.0010 (0.0011)  time: 0.0316  data: 0.0027  max mem: 281\n",
            "2021/05/21 21:30:30\tINFO\ttorchdistill.misc.log\tEpoch: [176]  [200/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 3647.4190988640685  loss: 0.0010 (0.0012)  time: 0.0325  data: 0.0038  max mem: 281\n",
            "2021/05/21 21:30:33\tINFO\ttorchdistill.misc.log\tEpoch: [176]  [300/352]  eta: 0:00:01  lr: 0.0010000000000000002  img/s: 5393.465124923398  loss: 0.0009 (0.0012)  time: 0.0311  data: 0.0038  max mem: 281\n",
            "2021/05/21 21:30:34\tINFO\ttorchdistill.misc.log\tEpoch: [176] Total time: 0:00:12\n",
            "2021/05/21 21:30:35\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:26  acc1: 77.3438 (77.3438)  acc5: 99.2188 (99.2188)  time: 0.6511  data: 0.6249  max mem: 281\n",
            "2021/05/21 21:30:36\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:30:36\tINFO\t__main__\t * Acc@1 85.0200\tAcc@5 99.0200\n",
            "\n",
            "2021/05/21 21:30:37\tINFO\ttorchdistill.misc.log\tEpoch: [177]  [  0/352]  eta: 0:03:36  lr: 0.0010000000000000002  img/s: 1238.9624183345911  loss: 0.0005 (0.0005)  time: 0.6146  data: 0.5113  max mem: 281\n",
            "2021/05/21 21:30:40\tINFO\ttorchdistill.misc.log\tEpoch: [177]  [100/352]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 4111.023653641466  loss: 0.0009 (0.0011)  time: 0.0317  data: 0.0043  max mem: 281\n",
            "2021/05/21 21:30:43\tINFO\ttorchdistill.misc.log\tEpoch: [177]  [200/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 4955.014923995607  loss: 0.0010 (0.0011)  time: 0.0309  data: 0.0026  max mem: 281\n",
            "2021/05/21 21:30:47\tINFO\ttorchdistill.misc.log\tEpoch: [177]  [300/352]  eta: 0:00:01  lr: 0.0010000000000000002  img/s: 5349.664315038463  loss: 0.0008 (0.0011)  time: 0.0299  data: 0.0026  max mem: 281\n",
            "2021/05/21 21:30:48\tINFO\ttorchdistill.misc.log\tEpoch: [177] Total time: 0:00:12\n",
            "2021/05/21 21:30:49\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 78.1250 (78.1250)  acc5: 99.2188 (99.2188)  time: 0.5570  data: 0.5211  max mem: 281\n",
            "2021/05/21 21:30:50\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:30:50\tINFO\t__main__\t * Acc@1 85.2000\tAcc@5 99.0800\n",
            "\n",
            "2021/05/21 21:30:50\tINFO\ttorchdistill.misc.log\tEpoch: [178]  [  0/352]  eta: 0:03:40  lr: 0.0010000000000000002  img/s: 1038.1900441288517  loss: 0.0012 (0.0012)  time: 0.6252  data: 0.5019  max mem: 281\n",
            "2021/05/21 21:30:54\tINFO\ttorchdistill.misc.log\tEpoch: [178]  [100/352]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 4492.944397951327  loss: 0.0013 (0.0012)  time: 0.0316  data: 0.0024  max mem: 281\n",
            "2021/05/21 21:30:57\tINFO\ttorchdistill.misc.log\tEpoch: [178]  [200/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 3986.507306641321  loss: 0.0010 (0.0011)  time: 0.0310  data: 0.0033  max mem: 281\n",
            "2021/05/21 21:31:00\tINFO\ttorchdistill.misc.log\tEpoch: [178]  [300/352]  eta: 0:00:01  lr: 0.0010000000000000002  img/s: 5364.739212982393  loss: 0.0009 (0.0011)  time: 0.0310  data: 0.0014  max mem: 281\n",
            "2021/05/21 21:31:02\tINFO\ttorchdistill.misc.log\tEpoch: [178] Total time: 0:00:12\n",
            "2021/05/21 21:31:03\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:23  acc1: 78.1250 (78.1250)  acc5: 99.2188 (99.2188)  time: 0.5845  data: 0.5325  max mem: 281\n",
            "2021/05/21 21:31:04\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:31:04\tINFO\t__main__\t * Acc@1 85.1600\tAcc@5 99.1000\n",
            "\n",
            "2021/05/21 21:31:04\tINFO\ttorchdistill.misc.log\tEpoch: [179]  [  0/352]  eta: 0:03:54  lr: 0.0010000000000000002  img/s: 851.7596349721089  loss: 0.0010 (0.0010)  time: 0.6659  data: 0.5156  max mem: 281\n",
            "2021/05/21 21:31:08\tINFO\ttorchdistill.misc.log\tEpoch: [179]  [100/352]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 5121.006057021853  loss: 0.0011 (0.0011)  time: 0.0306  data: 0.0040  max mem: 281\n",
            "2021/05/21 21:31:11\tINFO\ttorchdistill.misc.log\tEpoch: [179]  [200/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 3741.1564276953955  loss: 0.0010 (0.0011)  time: 0.0325  data: 0.0045  max mem: 281\n",
            "2021/05/21 21:31:14\tINFO\ttorchdistill.misc.log\tEpoch: [179]  [300/352]  eta: 0:00:01  lr: 0.0010000000000000002  img/s: 5066.492823101968  loss: 0.0009 (0.0011)  time: 0.0315  data: 0.0031  max mem: 281\n",
            "2021/05/21 21:31:16\tINFO\ttorchdistill.misc.log\tEpoch: [179] Total time: 0:00:12\n",
            "2021/05/21 21:31:16\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:24  acc1: 78.1250 (78.1250)  acc5: 100.0000 (100.0000)  time: 0.6080  data: 0.5580  max mem: 281\n",
            "2021/05/21 21:31:17\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:31:17\tINFO\t__main__\t * Acc@1 85.0000\tAcc@5 99.0400\n",
            "\n",
            "2021/05/21 21:31:18\tINFO\ttorchdistill.misc.log\tEpoch: [180]  [  0/352]  eta: 0:04:19  lr: 0.0010000000000000002  img/s: 976.8322501291839  loss: 0.0020 (0.0020)  time: 0.7362  data: 0.6051  max mem: 281\n",
            "2021/05/21 21:31:22\tINFO\ttorchdistill.misc.log\tEpoch: [180]  [100/352]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 4808.8183943462645  loss: 0.0010 (0.0011)  time: 0.0324  data: 0.0051  max mem: 281\n",
            "2021/05/21 21:31:25\tINFO\ttorchdistill.misc.log\tEpoch: [180]  [200/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 4837.067077510789  loss: 0.0010 (0.0011)  time: 0.0312  data: 0.0034  max mem: 281\n",
            "2021/05/21 21:31:28\tINFO\ttorchdistill.misc.log\tEpoch: [180]  [300/352]  eta: 0:00:01  lr: 0.0010000000000000002  img/s: 5132.805384527133  loss: 0.0011 (0.0011)  time: 0.0309  data: 0.0034  max mem: 281\n",
            "2021/05/21 21:31:30\tINFO\ttorchdistill.misc.log\tEpoch: [180] Total time: 0:00:12\n",
            "2021/05/21 21:31:30\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:24  acc1: 78.1250 (78.1250)  acc5: 99.2188 (99.2188)  time: 0.6013  data: 0.5714  max mem: 281\n",
            "2021/05/21 21:31:31\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:31:31\tINFO\t__main__\t * Acc@1 85.1800\tAcc@5 99.0600\n",
            "\n",
            "2021/05/21 21:31:32\tINFO\ttorchdistill.misc.log\tEpoch: [181]  [  0/352]  eta: 0:03:47  lr: 0.0010000000000000002  img/s: 1230.6835076265709  loss: 0.0014 (0.0014)  time: 0.6465  data: 0.5425  max mem: 281\n",
            "2021/05/21 21:31:36\tINFO\ttorchdistill.misc.log\tEpoch: [181]  [100/352]  eta: 0:00:10  lr: 0.0010000000000000002  img/s: 5265.556861091223  loss: 0.0010 (0.0011)  time: 0.0319  data: 0.0035  max mem: 281\n",
            "2021/05/21 21:31:39\tINFO\ttorchdistill.misc.log\tEpoch: [181]  [200/352]  eta: 0:00:05  lr: 0.0010000000000000002  img/s: 4007.336697220315  loss: 0.0010 (0.0011)  time: 0.0314  data: 0.0036  max mem: 281\n",
            "2021/05/21 21:31:42\tINFO\ttorchdistill.misc.log\tEpoch: [181]  [300/352]  eta: 0:00:01  lr: 0.0010000000000000002  img/s: 5394.440601669966  loss: 0.0010 (0.0011)  time: 0.0315  data: 0.0027  max mem: 281\n",
            "2021/05/21 21:31:44\tINFO\ttorchdistill.misc.log\tEpoch: [181] Total time: 0:00:12\n",
            "2021/05/21 21:31:44\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/40]  eta: 0:00:22  acc1: 78.9062 (78.9062)  acc5: 100.0000 (100.0000)  time: 0.5696  data: 0.5213  max mem: 281\n",
            "2021/05/21 21:31:45\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:01\n",
            "2021/05/21 21:31:45\tINFO\t__main__\t * Acc@1 84.9400\tAcc@5 99.1000\n",
            "\n",
            "2021/05/21 21:31:45\tINFO\t__main__\tTraining time 0:41:44\n",
            "2021/05/21 21:31:45\tINFO\ttorchdistill.common.main_util\tLoading model parameters\n",
            "2021/05/21 21:31:45\tINFO\t__main__\t[Student: resnet20]\n",
            "2021/05/21 21:31:46\tINFO\ttorchdistill.misc.log\tTest:  [    0/10000]  eta: 1:09:24  acc1: 100.0000 (100.0000)  acc5: 100.0000 (100.0000)  time: 0.4165  data: 0.3767  max mem: 281\n",
            "2021/05/21 21:31:50\tINFO\ttorchdistill.misc.log\tTest:  [ 1000/10000]  eta: 0:00:45  acc1: 100.0000 (85.2148)  acc5: 100.0000 (99.4006)  time: 0.0046  data: 0.0001  max mem: 281\n",
            "2021/05/21 21:31:55\tINFO\ttorchdistill.misc.log\tTest:  [ 2000/10000]  eta: 0:00:39  acc1: 100.0000 (85.1574)  acc5: 100.0000 (99.0505)  time: 0.0049  data: 0.0001  max mem: 281\n",
            "2021/05/21 21:32:00\tINFO\ttorchdistill.misc.log\tTest:  [ 3000/10000]  eta: 0:00:34  acc1: 100.0000 (84.4385)  acc5: 100.0000 (98.9670)  time: 0.0048  data: 0.0001  max mem: 281\n",
            "2021/05/21 21:32:05\tINFO\ttorchdistill.misc.log\tTest:  [ 4000/10000]  eta: 0:00:29  acc1: 100.0000 (84.0790)  acc5: 100.0000 (98.9003)  time: 0.0049  data: 0.0002  max mem: 281\n",
            "2021/05/21 21:32:10\tINFO\ttorchdistill.misc.log\tTest:  [ 5000/10000]  eta: 0:00:24  acc1: 100.0000 (84.3431)  acc5: 100.0000 (98.9002)  time: 0.0047  data: 0.0002  max mem: 281\n",
            "2021/05/21 21:32:14\tINFO\ttorchdistill.misc.log\tTest:  [ 6000/10000]  eta: 0:00:19  acc1: 100.0000 (84.1860)  acc5: 100.0000 (98.8835)  time: 0.0047  data: 0.0001  max mem: 281\n",
            "2021/05/21 21:32:19\tINFO\ttorchdistill.misc.log\tTest:  [ 7000/10000]  eta: 0:00:14  acc1: 100.0000 (84.2165)  acc5: 100.0000 (98.9287)  time: 0.0050  data: 0.0002  max mem: 281\n",
            "2021/05/21 21:32:24\tINFO\ttorchdistill.misc.log\tTest:  [ 8000/10000]  eta: 0:00:09  acc1: 100.0000 (84.3395)  acc5: 100.0000 (98.9876)  time: 0.0047  data: 0.0001  max mem: 281\n",
            "2021/05/21 21:32:29\tINFO\ttorchdistill.misc.log\tTest:  [ 9000/10000]  eta: 0:00:04  acc1: 100.0000 (84.3240)  acc5: 100.0000 (99.0223)  time: 0.0045  data: 0.0001  max mem: 281\n",
            "2021/05/21 21:32:34\tINFO\ttorchdistill.misc.log\tTest: Total time: 0:00:48\n",
            "2021/05/21 21:32:34\tINFO\t__main__\t * Acc@1 84.3000\tAcc@5 99.0200\n",
            "\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "YSxN-BkYUjf7"
      },
      "source": [
        "### 4.2 Final run with hyperparameters determinded by the above hyperparameter-tuning\n",
        "Once you tune the hyperparameters, you can update the values in **a config file whose name ends with \"-final_run.yaml\"**. Notice that the only difference between default example configs for hyperparameter tuning and final run is datasets entry.  \n",
        "Here, the example final run config reuses the hyperparameters described in the original paper and/or the official repository."
      ]
    },
    {
      "cell_type": "code",
      "metadata": {
        "colab": {
          "base_uri": "https://localhost:8080/"
        },
        "id": "4pMTJhXdw_tH",
        "outputId": "936a7696-9048-4ed4-b28c-35ea06d3b7dc"
      },
      "source": [
        "!python torchdistill/examples/image_classification.py --config torchdistill/configs/sample/cifar10/ce/resnet20-final_run.yaml --log log/cifar10/ce/resnet20-final_run.log"
      ],
      "execution_count": 5,
      "outputs": [
        {
          "output_type": "stream",
          "text": [
            "2021/05/21 21:32:35\tINFO\ttorchdistill.common.main_util\tNot using distributed mode\n",
            "2021/05/21 21:32:35\tINFO\t__main__\tNamespace(adjust_lr=False, config='torchdistill/configs/sample/cifar10/ce/resnet20-final_run.yaml', device='cuda', dist_url='env://', log='log/cifar10/ce/resnet20-final_run.log', seed=None, start_epoch=0, student_only=False, sync_bn=False, test_only=False, world_size=1)\n",
            "2021/05/21 21:32:35\tINFO\ttorchdistill.datasets.util\tLoading train data\n",
            "Files already downloaded and verified\n",
            "2021/05/21 21:32:36\tINFO\ttorchdistill.datasets.util\tdataset_id `cifar10/train`: 0.9385907649993896 sec\n",
            "2021/05/21 21:32:36\tINFO\ttorchdistill.datasets.util\tLoading val data\n",
            "Files already downloaded and verified\n",
            "2021/05/21 21:32:37\tINFO\ttorchdistill.datasets.util\tdataset_id `cifar10/val`: 0.7459437847137451 sec\n",
            "2021/05/21 21:32:37\tINFO\ttorchdistill.datasets.util\tLoading test data\n",
            "Files already downloaded and verified\n",
            "2021/05/21 21:32:38\tINFO\ttorchdistill.datasets.util\tdataset_id `cifar10/test`: 0.7554829120635986 sec\n",
            "2021/05/21 21:32:38\tINFO\ttorchdistill.common.main_util\tckpt file is not found at `./resource/ckpt/cifar10/ce/cifar10-resnet20-final_run.pt`\n",
            "2021/05/21 21:32:41\tINFO\t__main__\tStart training\n",
            "/usr/local/lib/python3.7/dist-packages/torch/utils/data/dataloader.py:477: UserWarning: This DataLoader will create 16 worker processes in total. Our suggested max number of worker in current system is 2, which is smaller than what this DataLoader is going to create. Please be aware that excessive worker creation might get DataLoader running slow or even freeze, lower the worker number to avoid potential slowness/freeze if necessary.\n",
            "  cpuset_checked))\n",
            "2021/05/21 21:32:41\tINFO\ttorchdistill.models.util\t[student model]\n",
            "2021/05/21 21:32:41\tINFO\ttorchdistill.models.util\tUsing the original student model\n",
            "2021/05/21 21:32:41\tINFO\ttorchdistill.core.training\tLoss = 1.0 * OrgLoss\n",
            "2021/05/21 21:32:42\tINFO\ttorchdistill.misc.log\tEpoch: [0]  [  0/391]  eta: 0:07:25  lr: 0.1  img/s: 284.06725070544456  loss: 2.4288 (2.4288)  time: 1.1396  data: 0.6890  max mem: 281\n",
            "2021/05/21 21:32:47\tINFO\ttorchdistill.misc.log\tEpoch: [0]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 4320.9969818184745  loss: 1.7297 (1.9437)  time: 0.0389  data: 0.0047  max mem: 281\n",
            "2021/05/21 21:32:51\tINFO\ttorchdistill.misc.log\tEpoch: [0]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 2560.6007268703556  loss: 1.5986 (1.7926)  time: 0.0385  data: 0.0041  max mem: 281\n",
            "2021/05/21 21:32:55\tINFO\ttorchdistill.misc.log\tEpoch: [0]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 4078.512481577708  loss: 1.3612 (1.6792)  time: 0.0393  data: 0.0048  max mem: 281\n",
            "2021/05/21 21:32:58\tINFO\ttorchdistill.misc.log\tEpoch: [0] Total time: 0:00:16\n",
            "2021/05/21 21:32:59\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:46  acc1: 36.7188 (36.7188)  acc5: 93.7500 (93.7500)  time: 0.5861  data: 0.5385  max mem: 281\n",
            "2021/05/21 21:33:00\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:33:00\tINFO\t__main__\t * Acc@1 44.3400\tAcc@5 92.5800\n",
            "\n",
            "2021/05/21 21:33:00\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 0.0000 -> 44.3400)\n",
            "2021/05/21 21:33:01\tINFO\ttorchdistill.misc.log\tEpoch: [1]  [  0/391]  eta: 0:04:34  lr: 0.1  img/s: 827.6270558836542  loss: 1.2389 (1.2389)  time: 0.7018  data: 0.5471  max mem: 281\n",
            "2021/05/21 21:33:06\tINFO\ttorchdistill.misc.log\tEpoch: [1]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 3794.6234291287938  loss: 1.1277 (1.1672)  time: 0.0393  data: 0.0051  max mem: 281\n",
            "2021/05/21 21:33:10\tINFO\ttorchdistill.misc.log\tEpoch: [1]  [200/391]  eta: 0:00:09  lr: 0.1  img/s: 4058.195913615989  loss: 1.0099 (1.1380)  time: 0.0402  data: 0.0042  max mem: 281\n",
            "2021/05/21 21:33:14\tINFO\ttorchdistill.misc.log\tEpoch: [1]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 3911.1718269637054  loss: 1.0006 (1.1136)  time: 0.0406  data: 0.0051  max mem: 281\n",
            "2021/05/21 21:33:18\tINFO\ttorchdistill.misc.log\tEpoch: [1] Total time: 0:00:17\n",
            "2021/05/21 21:33:18\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:48  acc1: 64.0625 (64.0625)  acc5: 94.5312 (94.5312)  time: 0.6197  data: 0.5940  max mem: 281\n",
            "2021/05/21 21:33:20\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:33:20\tINFO\t__main__\t * Acc@1 59.3900\tAcc@5 95.1200\n",
            "\n",
            "2021/05/21 21:33:20\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 44.3400 -> 59.3900)\n",
            "2021/05/21 21:33:21\tINFO\ttorchdistill.misc.log\tEpoch: [2]  [  0/391]  eta: 0:06:00  lr: 0.1  img/s: 1096.5187106577835  loss: 0.9042 (0.9042)  time: 0.9215  data: 0.8048  max mem: 281\n",
            "2021/05/21 21:33:26\tINFO\ttorchdistill.misc.log\tEpoch: [2]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 3046.3180734923626  loss: 0.8611 (0.9495)  time: 0.0410  data: 0.0024  max mem: 281\n",
            "2021/05/21 21:33:30\tINFO\ttorchdistill.misc.log\tEpoch: [2]  [200/391]  eta: 0:00:09  lr: 0.1  img/s: 2986.1663978285296  loss: 0.8412 (0.9134)  time: 0.0421  data: 0.0049  max mem: 281\n",
            "2021/05/21 21:33:34\tINFO\ttorchdistill.misc.log\tEpoch: [2]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 3689.9358882718425  loss: 0.8353 (0.8931)  time: 0.0406  data: 0.0039  max mem: 281\n",
            "2021/05/21 21:33:37\tINFO\ttorchdistill.misc.log\tEpoch: [2] Total time: 0:00:16\n",
            "2021/05/21 21:33:38\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:49  acc1: 65.6250 (65.6250)  acc5: 98.4375 (98.4375)  time: 0.6303  data: 0.5959  max mem: 281\n",
            "2021/05/21 21:33:40\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:33:40\tINFO\t__main__\t * Acc@1 65.5400\tAcc@5 96.4900\n",
            "\n",
            "2021/05/21 21:33:40\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 59.3900 -> 65.5400)\n",
            "2021/05/21 21:33:41\tINFO\ttorchdistill.misc.log\tEpoch: [3]  [  0/391]  eta: 0:05:45  lr: 0.1  img/s: 993.3922826131204  loss: 0.9069 (0.9069)  time: 0.8827  data: 0.7538  max mem: 281\n",
            "2021/05/21 21:33:45\tINFO\ttorchdistill.misc.log\tEpoch: [3]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 3656.4862865821683  loss: 0.7576 (0.7619)  time: 0.0400  data: 0.0045  max mem: 281\n",
            "2021/05/21 21:33:49\tINFO\ttorchdistill.misc.log\tEpoch: [3]  [200/391]  eta: 0:00:09  lr: 0.1  img/s: 3221.9536335211756  loss: 0.7324 (0.7592)  time: 0.0395  data: 0.0052  max mem: 281\n",
            "2021/05/21 21:33:53\tINFO\ttorchdistill.misc.log\tEpoch: [3]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 3171.4964083175805  loss: 0.7403 (0.7488)  time: 0.0413  data: 0.0061  max mem: 281\n",
            "2021/05/21 21:33:57\tINFO\ttorchdistill.misc.log\tEpoch: [3] Total time: 0:00:16\n",
            "2021/05/21 21:33:57\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:46  acc1: 79.6875 (79.6875)  acc5: 99.2188 (99.2188)  time: 0.5853  data: 0.5428  max mem: 281\n",
            "2021/05/21 21:33:59\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:33:59\tINFO\t__main__\t * Acc@1 74.8000\tAcc@5 98.3700\n",
            "\n",
            "2021/05/21 21:33:59\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 65.5400 -> 74.8000)\n",
            "2021/05/21 21:34:00\tINFO\ttorchdistill.misc.log\tEpoch: [4]  [  0/391]  eta: 0:04:27  lr: 0.1  img/s: 956.3226200633783  loss: 0.6208 (0.6208)  time: 0.6837  data: 0.5498  max mem: 281\n",
            "2021/05/21 21:34:05\tINFO\ttorchdistill.misc.log\tEpoch: [4]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 2879.1275379417602  loss: 0.6357 (0.6697)  time: 0.0395  data: 0.0045  max mem: 281\n",
            "2021/05/21 21:34:09\tINFO\ttorchdistill.misc.log\tEpoch: [4]  [200/391]  eta: 0:00:09  lr: 0.1  img/s: 3215.277209163048  loss: 0.6370 (0.6616)  time: 0.0415  data: 0.0052  max mem: 281\n",
            "2021/05/21 21:34:13\tINFO\ttorchdistill.misc.log\tEpoch: [4]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 3789.855372017507  loss: 0.6190 (0.6591)  time: 0.0408  data: 0.0053  max mem: 281\n",
            "2021/05/21 21:34:16\tINFO\ttorchdistill.misc.log\tEpoch: [4] Total time: 0:00:16\n",
            "2021/05/21 21:34:17\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:45  acc1: 72.6562 (72.6562)  acc5: 99.2188 (99.2188)  time: 0.5817  data: 0.5386  max mem: 281\n",
            "2021/05/21 21:34:19\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:34:19\tINFO\t__main__\t * Acc@1 71.3400\tAcc@5 97.3900\n",
            "\n",
            "2021/05/21 21:34:19\tINFO\ttorchdistill.misc.log\tEpoch: [5]  [  0/391]  eta: 0:04:30  lr: 0.1  img/s: 1004.2685352672801  loss: 0.5840 (0.5840)  time: 0.6929  data: 0.5654  max mem: 281\n",
            "2021/05/21 21:34:24\tINFO\ttorchdistill.misc.log\tEpoch: [5]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 5117.101251465444  loss: 0.6104 (0.6097)  time: 0.0406  data: 0.0057  max mem: 281\n",
            "2021/05/21 21:34:28\tINFO\ttorchdistill.misc.log\tEpoch: [5]  [200/391]  eta: 0:00:09  lr: 0.1  img/s: 4610.1147395989865  loss: 0.5827 (0.6045)  time: 0.0396  data: 0.0032  max mem: 281\n",
            "2021/05/21 21:34:32\tINFO\ttorchdistill.misc.log\tEpoch: [5]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 2844.5451183392765  loss: 0.5973 (0.5987)  time: 0.0431  data: 0.0055  max mem: 281\n",
            "2021/05/21 21:34:36\tINFO\ttorchdistill.misc.log\tEpoch: [5] Total time: 0:00:17\n",
            "2021/05/21 21:34:36\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:47  acc1: 78.9062 (78.9062)  acc5: 100.0000 (100.0000)  time: 0.6070  data: 0.5623  max mem: 281\n",
            "2021/05/21 21:34:38\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:34:38\tINFO\t__main__\t * Acc@1 74.5400\tAcc@5 98.1500\n",
            "\n",
            "2021/05/21 21:34:39\tINFO\ttorchdistill.misc.log\tEpoch: [6]  [  0/391]  eta: 0:05:17  lr: 0.1  img/s: 1209.9262871798107  loss: 0.5319 (0.5319)  time: 0.8119  data: 0.7061  max mem: 281\n",
            "2021/05/21 21:34:44\tINFO\ttorchdistill.misc.log\tEpoch: [6]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 4385.806112195799  loss: 0.6182 (0.5711)  time: 0.0393  data: 0.0036  max mem: 281\n",
            "2021/05/21 21:34:48\tINFO\ttorchdistill.misc.log\tEpoch: [6]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 2975.9038612906443  loss: 0.5160 (0.5621)  time: 0.0413  data: 0.0038  max mem: 281\n",
            "2021/05/21 21:34:52\tINFO\ttorchdistill.misc.log\tEpoch: [6]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 3579.6644307831816  loss: 0.5237 (0.5611)  time: 0.0384  data: 0.0036  max mem: 281\n",
            "2021/05/21 21:34:55\tINFO\ttorchdistill.misc.log\tEpoch: [6] Total time: 0:00:16\n",
            "2021/05/21 21:34:56\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:57  acc1: 75.7812 (75.7812)  acc5: 99.2188 (99.2188)  time: 0.7342  data: 0.7081  max mem: 281\n",
            "2021/05/21 21:34:58\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:34:58\tINFO\t__main__\t * Acc@1 72.5000\tAcc@5 98.0600\n",
            "\n",
            "2021/05/21 21:34:58\tINFO\ttorchdistill.misc.log\tEpoch: [7]  [  0/391]  eta: 0:04:36  lr: 0.1  img/s: 1053.4833393836523  loss: 0.5510 (0.5510)  time: 0.7076  data: 0.5860  max mem: 281\n",
            "2021/05/21 21:35:03\tINFO\ttorchdistill.misc.log\tEpoch: [7]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 3625.54640734738  loss: 0.4874 (0.5243)  time: 0.0413  data: 0.0057  max mem: 281\n",
            "2021/05/21 21:35:07\tINFO\ttorchdistill.misc.log\tEpoch: [7]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 2948.3336097488645  loss: 0.5176 (0.5304)  time: 0.0391  data: 0.0042  max mem: 281\n",
            "2021/05/21 21:35:11\tINFO\ttorchdistill.misc.log\tEpoch: [7]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 3025.238425821575  loss: 0.5130 (0.5241)  time: 0.0414  data: 0.0064  max mem: 281\n",
            "2021/05/21 21:35:15\tINFO\ttorchdistill.misc.log\tEpoch: [7] Total time: 0:00:16\n",
            "2021/05/21 21:35:15\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:48  acc1: 84.3750 (84.3750)  acc5: 99.2188 (99.2188)  time: 0.6201  data: 0.5733  max mem: 281\n",
            "2021/05/21 21:35:17\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:35:17\tINFO\t__main__\t * Acc@1 81.7100\tAcc@5 99.1700\n",
            "\n",
            "2021/05/21 21:35:17\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 74.8000 -> 81.7100)\n",
            "2021/05/21 21:35:18\tINFO\ttorchdistill.misc.log\tEpoch: [8]  [  0/391]  eta: 0:06:17  lr: 0.1  img/s: 936.3722669494482  loss: 0.4334 (0.4334)  time: 0.9657  data: 0.8290  max mem: 281\n",
            "2021/05/21 21:35:23\tINFO\ttorchdistill.misc.log\tEpoch: [8]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 3984.111017936521  loss: 0.5215 (0.5064)  time: 0.0399  data: 0.0039  max mem: 281\n",
            "2021/05/21 21:35:27\tINFO\ttorchdistill.misc.log\tEpoch: [8]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 3738.1347444645594  loss: 0.4652 (0.5022)  time: 0.0415  data: 0.0056  max mem: 281\n",
            "2021/05/21 21:35:31\tINFO\ttorchdistill.misc.log\tEpoch: [8]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 3635.2187207995344  loss: 0.4997 (0.5021)  time: 0.0410  data: 0.0049  max mem: 281\n",
            "2021/05/21 21:35:34\tINFO\ttorchdistill.misc.log\tEpoch: [8] Total time: 0:00:16\n",
            "2021/05/21 21:35:35\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:48  acc1: 82.0312 (82.0312)  acc5: 100.0000 (100.0000)  time: 0.6101  data: 0.5841  max mem: 281\n",
            "2021/05/21 21:35:37\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:35:37\tINFO\t__main__\t * Acc@1 80.4000\tAcc@5 98.8400\n",
            "\n",
            "2021/05/21 21:35:38\tINFO\ttorchdistill.misc.log\tEpoch: [9]  [  0/391]  eta: 0:04:54  lr: 0.1  img/s: 1182.355351279211  loss: 0.4994 (0.4994)  time: 0.7535  data: 0.6453  max mem: 281\n",
            "2021/05/21 21:35:42\tINFO\ttorchdistill.misc.log\tEpoch: [9]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 3278.300686959973  loss: 0.4610 (0.4681)  time: 0.0412  data: 0.0044  max mem: 281\n",
            "2021/05/21 21:35:46\tINFO\ttorchdistill.misc.log\tEpoch: [9]  [200/391]  eta: 0:00:09  lr: 0.1  img/s: 2781.1669826666252  loss: 0.4618 (0.4788)  time: 0.0415  data: 0.0061  max mem: 281\n",
            "2021/05/21 21:35:50\tINFO\ttorchdistill.misc.log\tEpoch: [9]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 3716.0125419622773  loss: 0.4474 (0.4742)  time: 0.0406  data: 0.0042  max mem: 281\n",
            "2021/05/21 21:35:54\tINFO\ttorchdistill.misc.log\tEpoch: [9] Total time: 0:00:16\n",
            "2021/05/21 21:35:54\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:50  acc1: 87.5000 (87.5000)  acc5: 99.2188 (99.2188)  time: 0.6342  data: 0.5967  max mem: 281\n",
            "2021/05/21 21:35:56\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:35:56\tINFO\t__main__\t * Acc@1 80.7500\tAcc@5 99.0000\n",
            "\n",
            "2021/05/21 21:35:57\tINFO\ttorchdistill.misc.log\tEpoch: [10]  [  0/391]  eta: 0:05:23  lr: 0.1  img/s: 1052.4982003246473  loss: 0.3586 (0.3586)  time: 0.8276  data: 0.7059  max mem: 281\n",
            "2021/05/21 21:36:02\tINFO\ttorchdistill.misc.log\tEpoch: [10]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 4350.973020722743  loss: 0.4628 (0.4558)  time: 0.0414  data: 0.0036  max mem: 281\n",
            "2021/05/21 21:36:06\tINFO\ttorchdistill.misc.log\tEpoch: [10]  [200/391]  eta: 0:00:09  lr: 0.1  img/s: 4404.516428612449  loss: 0.4508 (0.4630)  time: 0.0390  data: 0.0038  max mem: 281\n",
            "2021/05/21 21:36:10\tINFO\ttorchdistill.misc.log\tEpoch: [10]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 3597.679454790353  loss: 0.4415 (0.4631)  time: 0.0404  data: 0.0045  max mem: 281\n",
            "2021/05/21 21:36:13\tINFO\ttorchdistill.misc.log\tEpoch: [10] Total time: 0:00:17\n",
            "2021/05/21 21:36:14\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 85.1562 (85.1562)  acc5: 98.4375 (98.4375)  time: 0.5575  data: 0.5165  max mem: 281\n",
            "2021/05/21 21:36:16\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:36:16\tINFO\t__main__\t * Acc@1 80.0900\tAcc@5 98.9700\n",
            "\n",
            "2021/05/21 21:36:16\tINFO\ttorchdistill.misc.log\tEpoch: [11]  [  0/391]  eta: 0:04:36  lr: 0.1  img/s: 1269.5585319712447  loss: 0.4837 (0.4837)  time: 0.7071  data: 0.6062  max mem: 281\n",
            "2021/05/21 21:36:21\tINFO\ttorchdistill.misc.log\tEpoch: [11]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 3582.0767162406505  loss: 0.4434 (0.4333)  time: 0.0388  data: 0.0042  max mem: 281\n",
            "2021/05/21 21:36:25\tINFO\ttorchdistill.misc.log\tEpoch: [11]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 3158.1756532583504  loss: 0.4509 (0.4361)  time: 0.0395  data: 0.0036  max mem: 281\n",
            "2021/05/21 21:36:29\tINFO\ttorchdistill.misc.log\tEpoch: [11]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 3431.340155054614  loss: 0.4304 (0.4369)  time: 0.0411  data: 0.0040  max mem: 281\n",
            "2021/05/21 21:36:33\tINFO\ttorchdistill.misc.log\tEpoch: [11] Total time: 0:00:16\n",
            "2021/05/21 21:36:33\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:01:00  acc1: 82.8125 (82.8125)  acc5: 99.2188 (99.2188)  time: 0.7633  data: 0.7312  max mem: 281\n",
            "2021/05/21 21:36:35\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:36:35\tINFO\t__main__\t * Acc@1 80.6600\tAcc@5 98.7800\n",
            "\n",
            "2021/05/21 21:36:36\tINFO\ttorchdistill.misc.log\tEpoch: [12]  [  0/391]  eta: 0:05:54  lr: 0.1  img/s: 1250.3514681770755  loss: 0.3390 (0.3390)  time: 0.9062  data: 0.8038  max mem: 281\n",
            "2021/05/21 21:36:41\tINFO\ttorchdistill.misc.log\tEpoch: [12]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 2651.9608581180873  loss: 0.3808 (0.4230)  time: 0.0417  data: 0.0049  max mem: 281\n",
            "2021/05/21 21:36:45\tINFO\ttorchdistill.misc.log\tEpoch: [12]  [200/391]  eta: 0:00:09  lr: 0.1  img/s: 3764.134055024259  loss: 0.4324 (0.4237)  time: 0.0375  data: 0.0047  max mem: 281\n",
            "2021/05/21 21:36:49\tINFO\ttorchdistill.misc.log\tEpoch: [12]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 2906.419545363498  loss: 0.4202 (0.4277)  time: 0.0390  data: 0.0048  max mem: 281\n",
            "2021/05/21 21:36:52\tINFO\ttorchdistill.misc.log\tEpoch: [12] Total time: 0:00:17\n",
            "2021/05/21 21:36:53\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 81.2500 (81.2500)  acc5: 100.0000 (100.0000)  time: 0.5650  data: 0.5118  max mem: 281\n",
            "2021/05/21 21:36:55\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:36:55\tINFO\t__main__\t * Acc@1 79.5200\tAcc@5 98.9700\n",
            "\n",
            "2021/05/21 21:36:55\tINFO\ttorchdistill.misc.log\tEpoch: [13]  [  0/391]  eta: 0:04:53  lr: 0.1  img/s: 1164.6775150175395  loss: 0.4408 (0.4408)  time: 0.7495  data: 0.6396  max mem: 281\n",
            "2021/05/21 21:37:00\tINFO\ttorchdistill.misc.log\tEpoch: [13]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 3654.320976898049  loss: 0.4392 (0.4054)  time: 0.0417  data: 0.0048  max mem: 281\n",
            "2021/05/21 21:37:04\tINFO\ttorchdistill.misc.log\tEpoch: [13]  [200/391]  eta: 0:00:09  lr: 0.1  img/s: 3455.901949803346  loss: 0.4612 (0.4104)  time: 0.0403  data: 0.0048  max mem: 281\n",
            "2021/05/21 21:37:08\tINFO\ttorchdistill.misc.log\tEpoch: [13]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 3095.6236384918325  loss: 0.4376 (0.4143)  time: 0.0415  data: 0.0040  max mem: 281\n",
            "2021/05/21 21:37:12\tINFO\ttorchdistill.misc.log\tEpoch: [13] Total time: 0:00:17\n",
            "2021/05/21 21:37:13\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:50  acc1: 79.6875 (79.6875)  acc5: 97.6562 (97.6562)  time: 0.6337  data: 0.5902  max mem: 281\n",
            "2021/05/21 21:37:15\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:37:15\tINFO\t__main__\t * Acc@1 78.9600\tAcc@5 98.7600\n",
            "\n",
            "2021/05/21 21:37:15\tINFO\ttorchdistill.misc.log\tEpoch: [14]  [  0/391]  eta: 0:05:33  lr: 0.1  img/s: 1157.7205578233934  loss: 0.3151 (0.3151)  time: 0.8528  data: 0.7422  max mem: 281\n",
            "2021/05/21 21:37:20\tINFO\ttorchdistill.misc.log\tEpoch: [14]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 3932.11200058593  loss: 0.3970 (0.3905)  time: 0.0406  data: 0.0036  max mem: 281\n",
            "2021/05/21 21:37:24\tINFO\ttorchdistill.misc.log\tEpoch: [14]  [200/391]  eta: 0:00:09  lr: 0.1  img/s: 4319.224058311477  loss: 0.3857 (0.4026)  time: 0.0436  data: 0.0055  max mem: 281\n",
            "2021/05/21 21:37:28\tINFO\ttorchdistill.misc.log\tEpoch: [14]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 4365.833505460637  loss: 0.3934 (0.4046)  time: 0.0393  data: 0.0057  max mem: 281\n",
            "2021/05/21 21:37:31\tINFO\ttorchdistill.misc.log\tEpoch: [14] Total time: 0:00:16\n",
            "2021/05/21 21:37:32\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 86.7188 (86.7188)  acc5: 99.2188 (99.2188)  time: 0.5676  data: 0.5230  max mem: 281\n",
            "2021/05/21 21:37:34\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:37:34\tINFO\t__main__\t * Acc@1 83.4400\tAcc@5 99.1700\n",
            "\n",
            "2021/05/21 21:37:34\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 81.7100 -> 83.4400)\n",
            "2021/05/21 21:37:35\tINFO\ttorchdistill.misc.log\tEpoch: [15]  [  0/391]  eta: 0:05:21  lr: 0.1  img/s: 934.4783799872588  loss: 0.5102 (0.5102)  time: 0.8215  data: 0.6845  max mem: 281\n",
            "2021/05/21 21:37:40\tINFO\ttorchdistill.misc.log\tEpoch: [15]  [100/391]  eta: 0:00:17  lr: 0.1  img/s: 3637.0903868301607  loss: 0.3847 (0.3878)  time: 0.0428  data: 0.0047  max mem: 281\n",
            "2021/05/21 21:37:44\tINFO\ttorchdistill.misc.log\tEpoch: [15]  [200/391]  eta: 0:00:09  lr: 0.1  img/s: 3462.253727493164  loss: 0.4360 (0.3953)  time: 0.0395  data: 0.0052  max mem: 281\n",
            "2021/05/21 21:37:48\tINFO\ttorchdistill.misc.log\tEpoch: [15]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 3394.3938696542828  loss: 0.3793 (0.3937)  time: 0.0384  data: 0.0025  max mem: 281\n",
            "2021/05/21 21:37:51\tINFO\ttorchdistill.misc.log\tEpoch: [15] Total time: 0:00:17\n",
            "2021/05/21 21:37:52\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:47  acc1: 85.9375 (85.9375)  acc5: 99.2188 (99.2188)  time: 0.5964  data: 0.5551  max mem: 281\n",
            "2021/05/21 21:37:54\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:37:54\tINFO\t__main__\t * Acc@1 82.8200\tAcc@5 99.2000\n",
            "\n",
            "2021/05/21 21:37:55\tINFO\ttorchdistill.misc.log\tEpoch: [16]  [  0/391]  eta: 0:04:24  lr: 0.1  img/s: 1013.6926960701938  loss: 0.3586 (0.3586)  time: 0.6755  data: 0.5492  max mem: 281\n",
            "2021/05/21 21:37:59\tINFO\ttorchdistill.misc.log\tEpoch: [16]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 4030.0178054016724  loss: 0.3348 (0.3685)  time: 0.0394  data: 0.0030  max mem: 281\n",
            "2021/05/21 21:38:03\tINFO\ttorchdistill.misc.log\tEpoch: [16]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 4144.569169960474  loss: 0.4114 (0.3737)  time: 0.0424  data: 0.0045  max mem: 281\n",
            "2021/05/21 21:38:07\tINFO\ttorchdistill.misc.log\tEpoch: [16]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 3199.011535894747  loss: 0.3640 (0.3801)  time: 0.0417  data: 0.0057  max mem: 281\n",
            "2021/05/21 21:38:11\tINFO\ttorchdistill.misc.log\tEpoch: [16] Total time: 0:00:16\n",
            "2021/05/21 21:38:12\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:49  acc1: 89.8438 (89.8438)  acc5: 100.0000 (100.0000)  time: 0.6260  data: 0.5551  max mem: 281\n",
            "2021/05/21 21:38:13\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:38:13\tINFO\t__main__\t * Acc@1 83.9600\tAcc@5 99.3700\n",
            "\n",
            "2021/05/21 21:38:13\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 83.4400 -> 83.9600)\n",
            "2021/05/21 21:38:14\tINFO\ttorchdistill.misc.log\tEpoch: [17]  [  0/391]  eta: 0:06:13  lr: 0.1  img/s: 1123.5158219437521  loss: 0.3041 (0.3041)  time: 0.9541  data: 0.8402  max mem: 281\n",
            "2021/05/21 21:38:19\tINFO\ttorchdistill.misc.log\tEpoch: [17]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 3241.210777655021  loss: 0.3656 (0.3639)  time: 0.0393  data: 0.0037  max mem: 281\n",
            "2021/05/21 21:38:23\tINFO\ttorchdistill.misc.log\tEpoch: [17]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 3687.6041431986155  loss: 0.3630 (0.3747)  time: 0.0395  data: 0.0059  max mem: 281\n",
            "2021/05/21 21:38:27\tINFO\ttorchdistill.misc.log\tEpoch: [17]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 4069.762896366655  loss: 0.3305 (0.3748)  time: 0.0424  data: 0.0055  max mem: 281\n",
            "2021/05/21 21:38:30\tINFO\ttorchdistill.misc.log\tEpoch: [17] Total time: 0:00:16\n",
            "2021/05/21 21:38:31\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:48  acc1: 82.8125 (82.8125)  acc5: 100.0000 (100.0000)  time: 0.6196  data: 0.5667  max mem: 281\n",
            "2021/05/21 21:38:33\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:38:33\tINFO\t__main__\t * Acc@1 81.8200\tAcc@5 98.8500\n",
            "\n",
            "2021/05/21 21:38:34\tINFO\ttorchdistill.misc.log\tEpoch: [18]  [  0/391]  eta: 0:06:21  lr: 0.1  img/s: 1103.3014771765131  loss: 0.3063 (0.3063)  time: 0.9749  data: 0.8589  max mem: 281\n",
            "2021/05/21 21:38:38\tINFO\ttorchdistill.misc.log\tEpoch: [18]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 4026.6627065379625  loss: 0.3525 (0.3565)  time: 0.0397  data: 0.0046  max mem: 281\n",
            "2021/05/21 21:38:42\tINFO\ttorchdistill.misc.log\tEpoch: [18]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 4594.530697475396  loss: 0.3864 (0.3587)  time: 0.0401  data: 0.0071  max mem: 281\n",
            "2021/05/21 21:38:46\tINFO\ttorchdistill.misc.log\tEpoch: [18]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 3890.876433157948  loss: 0.3601 (0.3625)  time: 0.0405  data: 0.0051  max mem: 281\n",
            "2021/05/21 21:38:50\tINFO\ttorchdistill.misc.log\tEpoch: [18] Total time: 0:00:16\n",
            "2021/05/21 21:38:50\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:45  acc1: 81.2500 (81.2500)  acc5: 99.2188 (99.2188)  time: 0.5802  data: 0.5219  max mem: 281\n",
            "2021/05/21 21:38:52\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:38:52\tINFO\t__main__\t * Acc@1 80.8600\tAcc@5 98.7500\n",
            "\n",
            "2021/05/21 21:38:53\tINFO\ttorchdistill.misc.log\tEpoch: [19]  [  0/391]  eta: 0:04:15  lr: 0.1  img/s: 1115.2375840264565  loss: 0.3046 (0.3046)  time: 0.6546  data: 0.5398  max mem: 281\n",
            "2021/05/21 21:38:58\tINFO\ttorchdistill.misc.log\tEpoch: [19]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 3889.072570012894  loss: 0.3462 (0.3355)  time: 0.0397  data: 0.0035  max mem: 281\n",
            "2021/05/21 21:39:02\tINFO\ttorchdistill.misc.log\tEpoch: [19]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 3280.0632465160043  loss: 0.3269 (0.3470)  time: 0.0390  data: 0.0043  max mem: 281\n",
            "2021/05/21 21:39:06\tINFO\ttorchdistill.misc.log\tEpoch: [19]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 5329.113804433063  loss: 0.3282 (0.3516)  time: 0.0381  data: 0.0038  max mem: 281\n",
            "2021/05/21 21:39:09\tINFO\ttorchdistill.misc.log\tEpoch: [19] Total time: 0:00:16\n",
            "2021/05/21 21:39:10\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:49  acc1: 82.0312 (82.0312)  acc5: 100.0000 (100.0000)  time: 0.6268  data: 0.6031  max mem: 281\n",
            "2021/05/21 21:39:11\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:39:11\tINFO\t__main__\t * Acc@1 84.3400\tAcc@5 99.1100\n",
            "\n",
            "2021/05/21 21:39:11\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 83.9600 -> 84.3400)\n",
            "2021/05/21 21:39:12\tINFO\ttorchdistill.misc.log\tEpoch: [20]  [  0/391]  eta: 0:04:18  lr: 0.1  img/s: 1087.886524592755  loss: 0.3989 (0.3989)  time: 0.6616  data: 0.5439  max mem: 281\n",
            "2021/05/21 21:39:17\tINFO\ttorchdistill.misc.log\tEpoch: [20]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 4434.45759407936  loss: 0.3256 (0.3416)  time: 0.0409  data: 0.0039  max mem: 281\n",
            "2021/05/21 21:39:21\tINFO\ttorchdistill.misc.log\tEpoch: [20]  [200/391]  eta: 0:00:09  lr: 0.1  img/s: 3136.697741268302  loss: 0.3145 (0.3432)  time: 0.0422  data: 0.0067  max mem: 281\n",
            "2021/05/21 21:39:25\tINFO\ttorchdistill.misc.log\tEpoch: [20]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 2599.380801595832  loss: 0.3467 (0.3436)  time: 0.0394  data: 0.0037  max mem: 281\n",
            "2021/05/21 21:39:28\tINFO\ttorchdistill.misc.log\tEpoch: [20] Total time: 0:00:16\n",
            "2021/05/21 21:39:29\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:46  acc1: 83.5938 (83.5938)  acc5: 99.2188 (99.2188)  time: 0.5942  data: 0.5651  max mem: 281\n",
            "2021/05/21 21:39:31\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:39:31\tINFO\t__main__\t * Acc@1 83.3600\tAcc@5 99.0100\n",
            "\n",
            "2021/05/21 21:39:32\tINFO\ttorchdistill.misc.log\tEpoch: [21]  [  0/391]  eta: 0:04:43  lr: 0.1  img/s: 1339.6520359123053  loss: 0.2927 (0.2927)  time: 0.7242  data: 0.6286  max mem: 281\n",
            "2021/05/21 21:39:36\tINFO\ttorchdistill.misc.log\tEpoch: [21]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 3311.2790161224666  loss: 0.3764 (0.3355)  time: 0.0396  data: 0.0025  max mem: 281\n",
            "2021/05/21 21:39:40\tINFO\ttorchdistill.misc.log\tEpoch: [21]  [200/391]  eta: 0:00:09  lr: 0.1  img/s: 3788.8122851960848  loss: 0.3404 (0.3428)  time: 0.0419  data: 0.0060  max mem: 281\n",
            "2021/05/21 21:39:44\tINFO\ttorchdistill.misc.log\tEpoch: [21]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 3942.4492535450186  loss: 0.3532 (0.3417)  time: 0.0410  data: 0.0050  max mem: 281\n",
            "2021/05/21 21:39:48\tINFO\ttorchdistill.misc.log\tEpoch: [21] Total time: 0:00:17\n",
            "2021/05/21 21:39:49\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:58  acc1: 85.1562 (85.1562)  acc5: 100.0000 (100.0000)  time: 0.7464  data: 0.7374  max mem: 281\n",
            "2021/05/21 21:39:50\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:39:50\tINFO\t__main__\t * Acc@1 82.7600\tAcc@5 99.2900\n",
            "\n",
            "2021/05/21 21:39:51\tINFO\ttorchdistill.misc.log\tEpoch: [22]  [  0/391]  eta: 0:04:36  lr: 0.1  img/s: 1286.728914262158  loss: 0.3240 (0.3240)  time: 0.7069  data: 0.6074  max mem: 281\n",
            "2021/05/21 21:39:56\tINFO\ttorchdistill.misc.log\tEpoch: [22]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 3505.821009945343  loss: 0.3021 (0.3309)  time: 0.0407  data: 0.0047  max mem: 281\n",
            "2021/05/21 21:40:00\tINFO\ttorchdistill.misc.log\tEpoch: [22]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 3450.615488440551  loss: 0.3340 (0.3324)  time: 0.0403  data: 0.0063  max mem: 281\n",
            "2021/05/21 21:40:04\tINFO\ttorchdistill.misc.log\tEpoch: [22]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 4609.2439880834845  loss: 0.3512 (0.3377)  time: 0.0402  data: 0.0054  max mem: 281\n",
            "2021/05/21 21:40:07\tINFO\ttorchdistill.misc.log\tEpoch: [22] Total time: 0:00:16\n",
            "2021/05/21 21:40:08\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:49  acc1: 86.7188 (86.7188)  acc5: 99.2188 (99.2188)  time: 0.6303  data: 0.6116  max mem: 281\n",
            "2021/05/21 21:40:10\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:40:10\tINFO\t__main__\t * Acc@1 84.6900\tAcc@5 99.3900\n",
            "\n",
            "2021/05/21 21:40:10\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 84.3400 -> 84.6900)\n",
            "2021/05/21 21:40:10\tINFO\ttorchdistill.misc.log\tEpoch: [23]  [  0/391]  eta: 0:04:29  lr: 0.1  img/s: 978.3916840401802  loss: 0.2610 (0.2610)  time: 0.6897  data: 0.5589  max mem: 281\n",
            "2021/05/21 21:40:15\tINFO\ttorchdistill.misc.log\tEpoch: [23]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 5049.148510754357  loss: 0.3529 (0.3313)  time: 0.0410  data: 0.0023  max mem: 281\n",
            "2021/05/21 21:40:19\tINFO\ttorchdistill.misc.log\tEpoch: [23]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 4977.8484589993695  loss: 0.3247 (0.3290)  time: 0.0388  data: 0.0031  max mem: 281\n",
            "2021/05/21 21:40:23\tINFO\ttorchdistill.misc.log\tEpoch: [23]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 2657.2111481219345  loss: 0.2806 (0.3279)  time: 0.0411  data: 0.0030  max mem: 281\n",
            "2021/05/21 21:40:27\tINFO\ttorchdistill.misc.log\tEpoch: [23] Total time: 0:00:16\n",
            "2021/05/21 21:40:27\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:47  acc1: 89.8438 (89.8438)  acc5: 100.0000 (100.0000)  time: 0.5973  data: 0.5536  max mem: 281\n",
            "2021/05/21 21:40:29\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:40:29\tINFO\t__main__\t * Acc@1 84.1800\tAcc@5 99.2000\n",
            "\n",
            "2021/05/21 21:40:30\tINFO\ttorchdistill.misc.log\tEpoch: [24]  [  0/391]  eta: 0:05:36  lr: 0.1  img/s: 1111.5915150887727  loss: 0.4486 (0.4486)  time: 0.8605  data: 0.7453  max mem: 281\n",
            "2021/05/21 21:40:35\tINFO\ttorchdistill.misc.log\tEpoch: [24]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 4292.906700783624  loss: 0.2945 (0.3139)  time: 0.0386  data: 0.0052  max mem: 281\n",
            "2021/05/21 21:40:39\tINFO\ttorchdistill.misc.log\tEpoch: [24]  [200/391]  eta: 0:00:09  lr: 0.1  img/s: 3484.251627348541  loss: 0.3263 (0.3243)  time: 0.0417  data: 0.0063  max mem: 281\n",
            "2021/05/21 21:40:43\tINFO\ttorchdistill.misc.log\tEpoch: [24]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 3766.140860878837  loss: 0.3131 (0.3250)  time: 0.0409  data: 0.0051  max mem: 281\n",
            "2021/05/21 21:40:46\tINFO\ttorchdistill.misc.log\tEpoch: [24] Total time: 0:00:17\n",
            "2021/05/21 21:40:47\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:50  acc1: 83.5938 (83.5938)  acc5: 99.2188 (99.2188)  time: 0.6413  data: 0.6155  max mem: 281\n",
            "2021/05/21 21:40:49\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:40:49\tINFO\t__main__\t * Acc@1 83.3500\tAcc@5 99.3100\n",
            "\n",
            "2021/05/21 21:40:49\tINFO\ttorchdistill.misc.log\tEpoch: [25]  [  0/391]  eta: 0:04:20  lr: 0.1  img/s: 919.6632777691176  loss: 0.2035 (0.2035)  time: 0.6659  data: 0.5267  max mem: 281\n",
            "2021/05/21 21:40:54\tINFO\ttorchdistill.misc.log\tEpoch: [25]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 4000.6476497063995  loss: 0.2976 (0.3133)  time: 0.0396  data: 0.0032  max mem: 281\n",
            "2021/05/21 21:40:58\tINFO\ttorchdistill.misc.log\tEpoch: [25]  [200/391]  eta: 0:00:09  lr: 0.1  img/s: 3865.550969860173  loss: 0.2863 (0.3170)  time: 0.0406  data: 0.0063  max mem: 281\n",
            "2021/05/21 21:41:02\tINFO\ttorchdistill.misc.log\tEpoch: [25]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 4128.601182740297  loss: 0.2937 (0.3169)  time: 0.0416  data: 0.0058  max mem: 281\n",
            "2021/05/21 21:41:06\tINFO\ttorchdistill.misc.log\tEpoch: [25] Total time: 0:00:17\n",
            "2021/05/21 21:41:06\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:47  acc1: 82.0312 (82.0312)  acc5: 99.2188 (99.2188)  time: 0.5970  data: 0.5581  max mem: 281\n",
            "2021/05/21 21:41:08\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:41:08\tINFO\t__main__\t * Acc@1 84.2900\tAcc@5 99.2600\n",
            "\n",
            "2021/05/21 21:41:09\tINFO\ttorchdistill.misc.log\tEpoch: [26]  [  0/391]  eta: 0:06:03  lr: 0.1  img/s: 1102.3635923107565  loss: 0.3650 (0.3650)  time: 0.9294  data: 0.8133  max mem: 281\n",
            "2021/05/21 21:41:14\tINFO\ttorchdistill.misc.log\tEpoch: [26]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 2890.1786312225113  loss: 0.2810 (0.3013)  time: 0.0404  data: 0.0053  max mem: 281\n",
            "2021/05/21 21:41:18\tINFO\ttorchdistill.misc.log\tEpoch: [26]  [200/391]  eta: 0:00:09  lr: 0.1  img/s: 3519.887965907228  loss: 0.3348 (0.3114)  time: 0.0387  data: 0.0056  max mem: 281\n",
            "2021/05/21 21:41:22\tINFO\ttorchdistill.misc.log\tEpoch: [26]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 4504.895422697713  loss: 0.2837 (0.3104)  time: 0.0421  data: 0.0053  max mem: 281\n",
            "2021/05/21 21:41:25\tINFO\ttorchdistill.misc.log\tEpoch: [26] Total time: 0:00:16\n",
            "2021/05/21 21:41:26\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:56  acc1: 83.5938 (83.5938)  acc5: 100.0000 (100.0000)  time: 0.7117  data: 0.6736  max mem: 281\n",
            "2021/05/21 21:41:28\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:41:28\tINFO\t__main__\t * Acc@1 83.0300\tAcc@5 99.2800\n",
            "\n",
            "2021/05/21 21:41:28\tINFO\ttorchdistill.misc.log\tEpoch: [27]  [  0/391]  eta: 0:04:08  lr: 0.1  img/s: 1080.7798624643679  loss: 0.3078 (0.3078)  time: 0.6344  data: 0.5160  max mem: 281\n",
            "2021/05/21 21:41:33\tINFO\ttorchdistill.misc.log\tEpoch: [27]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 4164.760232103516  loss: 0.2642 (0.2940)  time: 0.0408  data: 0.0034  max mem: 281\n",
            "2021/05/21 21:41:37\tINFO\ttorchdistill.misc.log\tEpoch: [27]  [200/391]  eta: 0:00:09  lr: 0.1  img/s: 3789.1064310315624  loss: 0.2836 (0.2995)  time: 0.0398  data: 0.0038  max mem: 281\n",
            "2021/05/21 21:41:41\tINFO\ttorchdistill.misc.log\tEpoch: [27]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 3792.2914762412674  loss: 0.3231 (0.3109)  time: 0.0401  data: 0.0042  max mem: 281\n",
            "2021/05/21 21:41:45\tINFO\ttorchdistill.misc.log\tEpoch: [27] Total time: 0:00:17\n",
            "2021/05/21 21:41:46\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:49  acc1: 86.7188 (86.7188)  acc5: 100.0000 (100.0000)  time: 0.6234  data: 0.5834  max mem: 281\n",
            "2021/05/21 21:41:47\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:41:47\tINFO\t__main__\t * Acc@1 84.9300\tAcc@5 99.2200\n",
            "\n",
            "2021/05/21 21:41:47\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 84.6900 -> 84.9300)\n",
            "2021/05/21 21:41:48\tINFO\ttorchdistill.misc.log\tEpoch: [28]  [  0/391]  eta: 0:05:37  lr: 0.1  img/s: 1223.3725164921555  loss: 0.2267 (0.2267)  time: 0.8633  data: 0.7587  max mem: 281\n",
            "2021/05/21 21:41:53\tINFO\ttorchdistill.misc.log\tEpoch: [28]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 2620.812950026605  loss: 0.2969 (0.2972)  time: 0.0424  data: 0.0046  max mem: 281\n",
            "2021/05/21 21:41:57\tINFO\ttorchdistill.misc.log\tEpoch: [28]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 3644.522140534523  loss: 0.2982 (0.3046)  time: 0.0379  data: 0.0036  max mem: 281\n",
            "2021/05/21 21:42:01\tINFO\ttorchdistill.misc.log\tEpoch: [28]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 2722.4415168203163  loss: 0.3240 (0.3108)  time: 0.0410  data: 0.0059  max mem: 281\n",
            "2021/05/21 21:42:04\tINFO\ttorchdistill.misc.log\tEpoch: [28] Total time: 0:00:16\n",
            "2021/05/21 21:42:05\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:47  acc1: 85.9375 (85.9375)  acc5: 98.4375 (98.4375)  time: 0.6041  data: 0.5515  max mem: 281\n",
            "2021/05/21 21:42:07\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:42:07\tINFO\t__main__\t * Acc@1 84.4200\tAcc@5 99.3900\n",
            "\n",
            "2021/05/21 21:42:08\tINFO\ttorchdistill.misc.log\tEpoch: [29]  [  0/391]  eta: 0:05:55  lr: 0.1  img/s: 1140.262455105972  loss: 0.3407 (0.3407)  time: 0.9082  data: 0.7959  max mem: 281\n",
            "2021/05/21 21:42:12\tINFO\ttorchdistill.misc.log\tEpoch: [29]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 2951.2509386355014  loss: 0.2778 (0.2885)  time: 0.0414  data: 0.0036  max mem: 281\n",
            "2021/05/21 21:42:16\tINFO\ttorchdistill.misc.log\tEpoch: [29]  [200/391]  eta: 0:00:09  lr: 0.1  img/s: 2265.0869631254745  loss: 0.2995 (0.2922)  time: 0.0418  data: 0.0042  max mem: 281\n",
            "2021/05/21 21:42:20\tINFO\ttorchdistill.misc.log\tEpoch: [29]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 3187.3313899987534  loss: 0.2931 (0.2989)  time: 0.0403  data: 0.0023  max mem: 281\n",
            "2021/05/21 21:42:24\tINFO\ttorchdistill.misc.log\tEpoch: [29] Total time: 0:00:17\n",
            "2021/05/21 21:42:24\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:46  acc1: 89.0625 (89.0625)  acc5: 99.2188 (99.2188)  time: 0.5895  data: 0.5394  max mem: 281\n",
            "2021/05/21 21:42:26\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:42:26\tINFO\t__main__\t * Acc@1 85.2000\tAcc@5 99.2800\n",
            "\n",
            "2021/05/21 21:42:26\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 84.9300 -> 85.2000)\n",
            "2021/05/21 21:42:27\tINFO\ttorchdistill.misc.log\tEpoch: [30]  [  0/391]  eta: 0:04:09  lr: 0.1  img/s: 1206.2969731966916  loss: 0.3540 (0.3540)  time: 0.6374  data: 0.5313  max mem: 281\n",
            "2021/05/21 21:42:32\tINFO\ttorchdistill.misc.log\tEpoch: [30]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 3775.8618138340894  loss: 0.2719 (0.2837)  time: 0.0412  data: 0.0039  max mem: 281\n",
            "2021/05/21 21:42:36\tINFO\ttorchdistill.misc.log\tEpoch: [30]  [200/391]  eta: 0:00:09  lr: 0.1  img/s: 2961.8993374122115  loss: 0.2467 (0.2877)  time: 0.0411  data: 0.0043  max mem: 281\n",
            "2021/05/21 21:42:40\tINFO\ttorchdistill.misc.log\tEpoch: [30]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 2598.6510484230093  loss: 0.3118 (0.2935)  time: 0.0405  data: 0.0063  max mem: 281\n",
            "2021/05/21 21:42:43\tINFO\ttorchdistill.misc.log\tEpoch: [30] Total time: 0:00:17\n",
            "2021/05/21 21:42:44\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:45  acc1: 86.7188 (86.7188)  acc5: 99.2188 (99.2188)  time: 0.5786  data: 0.5509  max mem: 281\n",
            "2021/05/21 21:42:46\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:42:46\tINFO\t__main__\t * Acc@1 86.7900\tAcc@5 99.5100\n",
            "\n",
            "2021/05/21 21:42:46\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 85.2000 -> 86.7900)\n",
            "2021/05/21 21:42:47\tINFO\ttorchdistill.misc.log\tEpoch: [31]  [  0/391]  eta: 0:04:30  lr: 0.1  img/s: 874.5649125550603  loss: 0.2819 (0.2819)  time: 0.6924  data: 0.5460  max mem: 281\n",
            "2021/05/21 21:42:51\tINFO\ttorchdistill.misc.log\tEpoch: [31]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 4950.126429150992  loss: 0.2822 (0.2764)  time: 0.0408  data: 0.0048  max mem: 281\n",
            "2021/05/21 21:42:55\tINFO\ttorchdistill.misc.log\tEpoch: [31]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 4027.75023444592  loss: 0.2846 (0.2886)  time: 0.0395  data: 0.0034  max mem: 281\n",
            "2021/05/21 21:42:59\tINFO\ttorchdistill.misc.log\tEpoch: [31]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 3879.181144236188  loss: 0.2765 (0.2933)  time: 0.0397  data: 0.0054  max mem: 281\n",
            "2021/05/21 21:43:03\tINFO\ttorchdistill.misc.log\tEpoch: [31] Total time: 0:00:16\n",
            "2021/05/21 21:43:03\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:48  acc1: 85.1562 (85.1562)  acc5: 98.4375 (98.4375)  time: 0.6096  data: 0.5545  max mem: 281\n",
            "2021/05/21 21:43:05\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:43:05\tINFO\t__main__\t * Acc@1 82.4100\tAcc@5 98.9600\n",
            "\n",
            "2021/05/21 21:43:06\tINFO\ttorchdistill.misc.log\tEpoch: [32]  [  0/391]  eta: 0:04:18  lr: 0.1  img/s: 1059.4602991672257  loss: 0.2864 (0.2864)  time: 0.6622  data: 0.5414  max mem: 281\n",
            "2021/05/21 21:43:11\tINFO\ttorchdistill.misc.log\tEpoch: [32]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 3805.193260991289  loss: 0.2829 (0.2707)  time: 0.0421  data: 0.0035  max mem: 281\n",
            "2021/05/21 21:43:15\tINFO\ttorchdistill.misc.log\tEpoch: [32]  [200/391]  eta: 0:00:09  lr: 0.1  img/s: 3116.613232246417  loss: 0.2677 (0.2792)  time: 0.0401  data: 0.0039  max mem: 281\n",
            "2021/05/21 21:43:19\tINFO\ttorchdistill.misc.log\tEpoch: [32]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 2416.998293738154  loss: 0.3003 (0.2924)  time: 0.0428  data: 0.0068  max mem: 281\n",
            "2021/05/21 21:43:22\tINFO\ttorchdistill.misc.log\tEpoch: [32] Total time: 0:00:16\n",
            "2021/05/21 21:43:23\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:47  acc1: 88.2812 (88.2812)  acc5: 99.2188 (99.2188)  time: 0.6072  data: 0.5786  max mem: 281\n",
            "2021/05/21 21:43:25\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:43:25\tINFO\t__main__\t * Acc@1 85.9600\tAcc@5 99.4400\n",
            "\n",
            "2021/05/21 21:43:26\tINFO\ttorchdistill.misc.log\tEpoch: [33]  [  0/391]  eta: 0:05:30  lr: 0.1  img/s: 1202.7297822244425  loss: 0.2752 (0.2752)  time: 0.8443  data: 0.7379  max mem: 281\n",
            "2021/05/21 21:43:30\tINFO\ttorchdistill.misc.log\tEpoch: [33]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 3834.819620140144  loss: 0.2651 (0.2793)  time: 0.0404  data: 0.0039  max mem: 281\n",
            "2021/05/21 21:43:34\tINFO\ttorchdistill.misc.log\tEpoch: [33]  [200/391]  eta: 0:00:09  lr: 0.1  img/s: 3657.781720320218  loss: 0.2911 (0.2843)  time: 0.0392  data: 0.0044  max mem: 281\n",
            "2021/05/21 21:43:38\tINFO\ttorchdistill.misc.log\tEpoch: [33]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 3492.774736677748  loss: 0.2662 (0.2867)  time: 0.0413  data: 0.0062  max mem: 281\n",
            "2021/05/21 21:43:42\tINFO\ttorchdistill.misc.log\tEpoch: [33] Total time: 0:00:17\n",
            "2021/05/21 21:43:43\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:48  acc1: 82.8125 (82.8125)  acc5: 99.2188 (99.2188)  time: 0.6100  data: 0.5551  max mem: 281\n",
            "2021/05/21 21:43:44\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:43:44\tINFO\t__main__\t * Acc@1 84.5700\tAcc@5 99.5200\n",
            "\n",
            "2021/05/21 21:43:45\tINFO\ttorchdistill.misc.log\tEpoch: [34]  [  0/391]  eta: 0:05:24  lr: 0.1  img/s: 1073.2695853824318  loss: 0.3869 (0.3869)  time: 0.8300  data: 0.7107  max mem: 281\n",
            "2021/05/21 21:43:50\tINFO\ttorchdistill.misc.log\tEpoch: [34]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 3165.4564600862013  loss: 0.2509 (0.2732)  time: 0.0423  data: 0.0045  max mem: 281\n",
            "2021/05/21 21:43:54\tINFO\ttorchdistill.misc.log\tEpoch: [34]  [200/391]  eta: 0:00:09  lr: 0.1  img/s: 3581.0015341310814  loss: 0.2805 (0.2794)  time: 0.0396  data: 0.0048  max mem: 281\n",
            "2021/05/21 21:43:58\tINFO\ttorchdistill.misc.log\tEpoch: [34]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 3142.867499502406  loss: 0.3096 (0.2846)  time: 0.0418  data: 0.0077  max mem: 281\n",
            "2021/05/21 21:44:01\tINFO\ttorchdistill.misc.log\tEpoch: [34] Total time: 0:00:16\n",
            "2021/05/21 21:44:02\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:59  acc1: 90.6250 (90.6250)  acc5: 99.2188 (99.2188)  time: 0.7502  data: 0.7121  max mem: 281\n",
            "2021/05/21 21:44:04\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:44:04\tINFO\t__main__\t * Acc@1 85.9000\tAcc@5 99.3600\n",
            "\n",
            "2021/05/21 21:44:05\tINFO\ttorchdistill.misc.log\tEpoch: [35]  [  0/391]  eta: 0:05:41  lr: 0.1  img/s: 1132.696406569109  loss: 0.1688 (0.1688)  time: 0.8725  data: 0.7595  max mem: 281\n",
            "2021/05/21 21:44:09\tINFO\ttorchdistill.misc.log\tEpoch: [35]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 4062.648787722856  loss: 0.2564 (0.2666)  time: 0.0411  data: 0.0050  max mem: 281\n",
            "2021/05/21 21:44:13\tINFO\ttorchdistill.misc.log\tEpoch: [35]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 5175.158203200309  loss: 0.2628 (0.2756)  time: 0.0386  data: 0.0032  max mem: 281\n",
            "2021/05/21 21:44:17\tINFO\ttorchdistill.misc.log\tEpoch: [35]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 3972.525357761236  loss: 0.2934 (0.2779)  time: 0.0384  data: 0.0033  max mem: 281\n",
            "2021/05/21 21:44:21\tINFO\ttorchdistill.misc.log\tEpoch: [35] Total time: 0:00:16\n",
            "2021/05/21 21:44:21\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:49  acc1: 88.2812 (88.2812)  acc5: 99.2188 (99.2188)  time: 0.6285  data: 0.5915  max mem: 281\n",
            "2021/05/21 21:44:23\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:44:23\tINFO\t__main__\t * Acc@1 86.0400\tAcc@5 99.2100\n",
            "\n",
            "2021/05/21 21:44:24\tINFO\ttorchdistill.misc.log\tEpoch: [36]  [  0/391]  eta: 0:05:42  lr: 0.1  img/s: 1104.7817726853682  loss: 0.2680 (0.2680)  time: 0.8756  data: 0.7598  max mem: 281\n",
            "2021/05/21 21:44:29\tINFO\ttorchdistill.misc.log\tEpoch: [36]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 3036.325400416252  loss: 0.2905 (0.2919)  time: 0.0397  data: 0.0048  max mem: 281\n",
            "2021/05/21 21:44:33\tINFO\ttorchdistill.misc.log\tEpoch: [36]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 4292.872374281351  loss: 0.2903 (0.2815)  time: 0.0417  data: 0.0076  max mem: 281\n",
            "2021/05/21 21:44:37\tINFO\ttorchdistill.misc.log\tEpoch: [36]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 5024.4348444577545  loss: 0.2657 (0.2818)  time: 0.0376  data: 0.0030  max mem: 281\n",
            "2021/05/21 21:44:40\tINFO\ttorchdistill.misc.log\tEpoch: [36] Total time: 0:00:16\n",
            "2021/05/21 21:44:41\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:47  acc1: 84.3750 (84.3750)  acc5: 100.0000 (100.0000)  time: 0.5955  data: 0.5779  max mem: 281\n",
            "2021/05/21 21:44:43\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:44:43\tINFO\t__main__\t * Acc@1 84.3500\tAcc@5 99.3900\n",
            "\n",
            "2021/05/21 21:44:43\tINFO\ttorchdistill.misc.log\tEpoch: [37]  [  0/391]  eta: 0:04:26  lr: 0.1  img/s: 1164.6674085885045  loss: 0.1703 (0.1703)  time: 0.6807  data: 0.5708  max mem: 281\n",
            "2021/05/21 21:44:48\tINFO\ttorchdistill.misc.log\tEpoch: [37]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 3767.885350139663  loss: 0.2405 (0.2523)  time: 0.0399  data: 0.0034  max mem: 281\n",
            "2021/05/21 21:44:52\tINFO\ttorchdistill.misc.log\tEpoch: [37]  [200/391]  eta: 0:00:09  lr: 0.1  img/s: 2705.8798340801072  loss: 0.2960 (0.2759)  time: 0.0387  data: 0.0045  max mem: 281\n",
            "2021/05/21 21:44:56\tINFO\ttorchdistill.misc.log\tEpoch: [37]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 3142.4076044648136  loss: 0.2676 (0.2771)  time: 0.0383  data: 0.0040  max mem: 281\n",
            "2021/05/21 21:45:00\tINFO\ttorchdistill.misc.log\tEpoch: [37] Total time: 0:00:16\n",
            "2021/05/21 21:45:00\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:45  acc1: 91.4062 (91.4062)  acc5: 100.0000 (100.0000)  time: 0.5745  data: 0.5263  max mem: 281\n",
            "2021/05/21 21:45:02\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:45:02\tINFO\t__main__\t * Acc@1 87.0300\tAcc@5 99.3700\n",
            "\n",
            "2021/05/21 21:45:02\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 86.7900 -> 87.0300)\n",
            "2021/05/21 21:45:03\tINFO\ttorchdistill.misc.log\tEpoch: [38]  [  0/391]  eta: 0:04:15  lr: 0.1  img/s: 1196.3937148600194  loss: 0.2169 (0.2169)  time: 0.6537  data: 0.5467  max mem: 281\n",
            "2021/05/21 21:45:08\tINFO\ttorchdistill.misc.log\tEpoch: [38]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 3280.9051364316924  loss: 0.2704 (0.2595)  time: 0.0400  data: 0.0030  max mem: 281\n",
            "2021/05/21 21:45:12\tINFO\ttorchdistill.misc.log\tEpoch: [38]  [200/391]  eta: 0:00:09  lr: 0.1  img/s: 2910.7529222961984  loss: 0.2727 (0.2705)  time: 0.0407  data: 0.0046  max mem: 281\n",
            "2021/05/21 21:45:16\tINFO\ttorchdistill.misc.log\tEpoch: [38]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 3711.7477893543323  loss: 0.2945 (0.2757)  time: 0.0399  data: 0.0047  max mem: 281\n",
            "2021/05/21 21:45:19\tINFO\ttorchdistill.misc.log\tEpoch: [38] Total time: 0:00:16\n",
            "2021/05/21 21:45:20\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:47  acc1: 89.0625 (89.0625)  acc5: 100.0000 (100.0000)  time: 0.5971  data: 0.5530  max mem: 281\n",
            "2021/05/21 21:45:22\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:45:22\tINFO\t__main__\t * Acc@1 87.6100\tAcc@5 99.6400\n",
            "\n",
            "2021/05/21 21:45:22\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 87.0300 -> 87.6100)\n",
            "2021/05/21 21:45:22\tINFO\ttorchdistill.misc.log\tEpoch: [39]  [  0/391]  eta: 0:04:15  lr: 0.1  img/s: 1021.9941711385696  loss: 0.0970 (0.0970)  time: 0.6522  data: 0.5270  max mem: 281\n",
            "2021/05/21 21:45:27\tINFO\ttorchdistill.misc.log\tEpoch: [39]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 3555.130432479323  loss: 0.2596 (0.2625)  time: 0.0385  data: 0.0042  max mem: 281\n",
            "2021/05/21 21:45:31\tINFO\ttorchdistill.misc.log\tEpoch: [39]  [200/391]  eta: 0:00:09  lr: 0.1  img/s: 4365.123561886642  loss: 0.2435 (0.2638)  time: 0.0412  data: 0.0055  max mem: 281\n",
            "2021/05/21 21:45:35\tINFO\ttorchdistill.misc.log\tEpoch: [39]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 4458.283123375491  loss: 0.2768 (0.2707)  time: 0.0423  data: 0.0048  max mem: 281\n",
            "2021/05/21 21:45:39\tINFO\ttorchdistill.misc.log\tEpoch: [39] Total time: 0:00:17\n",
            "2021/05/21 21:45:39\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 85.1562 (85.1562)  acc5: 98.4375 (98.4375)  time: 0.5651  data: 0.5225  max mem: 281\n",
            "2021/05/21 21:45:41\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:45:41\tINFO\t__main__\t * Acc@1 83.0600\tAcc@5 99.0300\n",
            "\n",
            "2021/05/21 21:45:42\tINFO\ttorchdistill.misc.log\tEpoch: [40]  [  0/391]  eta: 0:04:56  lr: 0.1  img/s: 1118.4600955398753  loss: 0.2269 (0.2269)  time: 0.7594  data: 0.6449  max mem: 281\n",
            "2021/05/21 21:45:47\tINFO\ttorchdistill.misc.log\tEpoch: [40]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 3407.0385398884355  loss: 0.2474 (0.2624)  time: 0.0411  data: 0.0061  max mem: 281\n",
            "2021/05/21 21:45:51\tINFO\ttorchdistill.misc.log\tEpoch: [40]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 4186.2258922236  loss: 0.2728 (0.2664)  time: 0.0415  data: 0.0048  max mem: 281\n",
            "2021/05/21 21:45:55\tINFO\ttorchdistill.misc.log\tEpoch: [40]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 5040.56813444747  loss: 0.2772 (0.2695)  time: 0.0403  data: 0.0048  max mem: 281\n",
            "2021/05/21 21:45:58\tINFO\ttorchdistill.misc.log\tEpoch: [40] Total time: 0:00:16\n",
            "2021/05/21 21:45:59\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:45  acc1: 89.0625 (89.0625)  acc5: 99.2188 (99.2188)  time: 0.5711  data: 0.5399  max mem: 281\n",
            "2021/05/21 21:46:01\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:46:01\tINFO\t__main__\t * Acc@1 84.3400\tAcc@5 99.3800\n",
            "\n",
            "2021/05/21 21:46:01\tINFO\ttorchdistill.misc.log\tEpoch: [41]  [  0/391]  eta: 0:04:26  lr: 0.1  img/s: 1086.6424430842967  loss: 0.2225 (0.2225)  time: 0.6820  data: 0.5641  max mem: 281\n",
            "2021/05/21 21:46:06\tINFO\ttorchdistill.misc.log\tEpoch: [41]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 4042.854866523589  loss: 0.2762 (0.2700)  time: 0.0421  data: 0.0044  max mem: 281\n",
            "2021/05/21 21:46:10\tINFO\ttorchdistill.misc.log\tEpoch: [41]  [200/391]  eta: 0:00:09  lr: 0.1  img/s: 4375.190794406232  loss: 0.2653 (0.2704)  time: 0.0403  data: 0.0058  max mem: 281\n",
            "2021/05/21 21:46:14\tINFO\ttorchdistill.misc.log\tEpoch: [41]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 4304.471569224848  loss: 0.2492 (0.2688)  time: 0.0392  data: 0.0048  max mem: 281\n",
            "2021/05/21 21:46:18\tINFO\ttorchdistill.misc.log\tEpoch: [41] Total time: 0:00:17\n",
            "2021/05/21 21:46:18\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:47  acc1: 85.1562 (85.1562)  acc5: 99.2188 (99.2188)  time: 0.5960  data: 0.5504  max mem: 281\n",
            "2021/05/21 21:46:20\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:46:20\tINFO\t__main__\t * Acc@1 86.1000\tAcc@5 99.3900\n",
            "\n",
            "2021/05/21 21:46:21\tINFO\ttorchdistill.misc.log\tEpoch: [42]  [  0/391]  eta: 0:04:40  lr: 0.1  img/s: 1127.0371570841976  loss: 0.2203 (0.2203)  time: 0.7179  data: 0.6043  max mem: 281\n",
            "2021/05/21 21:46:26\tINFO\ttorchdistill.misc.log\tEpoch: [42]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 3253.5461999503063  loss: 0.2379 (0.2510)  time: 0.0417  data: 0.0055  max mem: 281\n",
            "2021/05/21 21:46:30\tINFO\ttorchdistill.misc.log\tEpoch: [42]  [200/391]  eta: 0:00:09  lr: 0.1  img/s: 4742.759695400979  loss: 0.2700 (0.2562)  time: 0.0404  data: 0.0042  max mem: 281\n",
            "2021/05/21 21:46:34\tINFO\ttorchdistill.misc.log\tEpoch: [42]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 3711.3115900952594  loss: 0.2604 (0.2622)  time: 0.0412  data: 0.0057  max mem: 281\n",
            "2021/05/21 21:46:37\tINFO\ttorchdistill.misc.log\tEpoch: [42] Total time: 0:00:17\n",
            "2021/05/21 21:46:38\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:47  acc1: 88.2812 (88.2812)  acc5: 99.2188 (99.2188)  time: 0.6069  data: 0.5799  max mem: 281\n",
            "2021/05/21 21:46:40\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:46:40\tINFO\t__main__\t * Acc@1 85.7600\tAcc@5 99.4600\n",
            "\n",
            "2021/05/21 21:46:41\tINFO\ttorchdistill.misc.log\tEpoch: [43]  [  0/391]  eta: 0:04:41  lr: 0.1  img/s: 1149.6214373509094  loss: 0.2047 (0.2047)  time: 0.7194  data: 0.6080  max mem: 281\n",
            "2021/05/21 21:46:45\tINFO\ttorchdistill.misc.log\tEpoch: [43]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 3403.3237104514133  loss: 0.2523 (0.2567)  time: 0.0402  data: 0.0042  max mem: 281\n",
            "2021/05/21 21:46:49\tINFO\ttorchdistill.misc.log\tEpoch: [43]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 4518.126605288405  loss: 0.2470 (0.2547)  time: 0.0396  data: 0.0037  max mem: 281\n",
            "2021/05/21 21:46:53\tINFO\ttorchdistill.misc.log\tEpoch: [43]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 4324.930413907551  loss: 0.3042 (0.2630)  time: 0.0405  data: 0.0049  max mem: 281\n",
            "2021/05/21 21:46:57\tINFO\ttorchdistill.misc.log\tEpoch: [43] Total time: 0:00:16\n",
            "2021/05/21 21:46:57\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:49  acc1: 92.1875 (92.1875)  acc5: 100.0000 (100.0000)  time: 0.6214  data: 0.5615  max mem: 281\n",
            "2021/05/21 21:46:59\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:46:59\tINFO\t__main__\t * Acc@1 86.7000\tAcc@5 99.4700\n",
            "\n",
            "2021/05/21 21:47:00\tINFO\ttorchdistill.misc.log\tEpoch: [44]  [  0/391]  eta: 0:05:44  lr: 0.1  img/s: 977.643389395937  loss: 0.2026 (0.2026)  time: 0.8806  data: 0.7496  max mem: 281\n",
            "2021/05/21 21:47:05\tINFO\ttorchdistill.misc.log\tEpoch: [44]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 3735.7417056334893  loss: 0.2163 (0.2439)  time: 0.0413  data: 0.0061  max mem: 281\n",
            "2021/05/21 21:47:09\tINFO\ttorchdistill.misc.log\tEpoch: [44]  [200/391]  eta: 0:00:09  lr: 0.1  img/s: 4143.993330966238  loss: 0.2446 (0.2551)  time: 0.0392  data: 0.0057  max mem: 281\n",
            "2021/05/21 21:47:13\tINFO\ttorchdistill.misc.log\tEpoch: [44]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 3540.360662872668  loss: 0.2412 (0.2589)  time: 0.0424  data: 0.0049  max mem: 281\n",
            "2021/05/21 21:47:16\tINFO\ttorchdistill.misc.log\tEpoch: [44] Total time: 0:00:17\n",
            "2021/05/21 21:47:17\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:45  acc1: 87.5000 (87.5000)  acc5: 100.0000 (100.0000)  time: 0.5733  data: 0.5347  max mem: 281\n",
            "2021/05/21 21:47:19\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:47:19\tINFO\t__main__\t * Acc@1 85.3400\tAcc@5 99.3400\n",
            "\n",
            "2021/05/21 21:47:20\tINFO\ttorchdistill.misc.log\tEpoch: [45]  [  0/391]  eta: 0:04:33  lr: 0.1  img/s: 924.2817654066785  loss: 0.2464 (0.2464)  time: 0.7005  data: 0.5620  max mem: 281\n",
            "2021/05/21 21:47:24\tINFO\ttorchdistill.misc.log\tEpoch: [45]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 3308.911630200308  loss: 0.2386 (0.2384)  time: 0.0406  data: 0.0039  max mem: 281\n",
            "2021/05/21 21:47:28\tINFO\ttorchdistill.misc.log\tEpoch: [45]  [200/391]  eta: 0:00:09  lr: 0.1  img/s: 3259.5314860237513  loss: 0.2661 (0.2503)  time: 0.0402  data: 0.0044  max mem: 281\n",
            "2021/05/21 21:47:33\tINFO\ttorchdistill.misc.log\tEpoch: [45]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 3689.656937466926  loss: 0.2321 (0.2522)  time: 0.0405  data: 0.0042  max mem: 281\n",
            "2021/05/21 21:47:36\tINFO\ttorchdistill.misc.log\tEpoch: [45] Total time: 0:00:17\n",
            "2021/05/21 21:47:37\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:48  acc1: 86.7188 (86.7188)  acc5: 100.0000 (100.0000)  time: 0.6114  data: 0.5484  max mem: 281\n",
            "2021/05/21 21:47:38\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:47:38\tINFO\t__main__\t * Acc@1 82.4500\tAcc@5 99.2100\n",
            "\n",
            "2021/05/21 21:47:39\tINFO\ttorchdistill.misc.log\tEpoch: [46]  [  0/391]  eta: 0:05:33  lr: 0.1  img/s: 1190.805111268346  loss: 0.1917 (0.1917)  time: 0.8522  data: 0.7446  max mem: 281\n",
            "2021/05/21 21:47:44\tINFO\ttorchdistill.misc.log\tEpoch: [46]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 3441.8773448218385  loss: 0.2290 (0.2588)  time: 0.0393  data: 0.0028  max mem: 281\n",
            "2021/05/21 21:47:48\tINFO\ttorchdistill.misc.log\tEpoch: [46]  [200/391]  eta: 0:00:09  lr: 0.1  img/s: 2171.9748362535956  loss: 0.2599 (0.2597)  time: 0.0418  data: 0.0049  max mem: 281\n",
            "2021/05/21 21:47:52\tINFO\ttorchdistill.misc.log\tEpoch: [46]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 2808.695510238247  loss: 0.2263 (0.2537)  time: 0.0408  data: 0.0039  max mem: 281\n",
            "2021/05/21 21:47:55\tINFO\ttorchdistill.misc.log\tEpoch: [46] Total time: 0:00:16\n",
            "2021/05/21 21:47:56\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:45  acc1: 91.4062 (91.4062)  acc5: 100.0000 (100.0000)  time: 0.5805  data: 0.5341  max mem: 281\n",
            "2021/05/21 21:47:58\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:47:58\tINFO\t__main__\t * Acc@1 86.0800\tAcc@5 99.4000\n",
            "\n",
            "2021/05/21 21:47:59\tINFO\ttorchdistill.misc.log\tEpoch: [47]  [  0/391]  eta: 0:05:15  lr: 0.1  img/s: 1309.6520708211565  loss: 0.2538 (0.2538)  time: 0.8057  data: 0.7079  max mem: 281\n",
            "2021/05/21 21:48:03\tINFO\ttorchdistill.misc.log\tEpoch: [47]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 4879.446972106846  loss: 0.2519 (0.2460)  time: 0.0393  data: 0.0048  max mem: 281\n",
            "2021/05/21 21:48:07\tINFO\ttorchdistill.misc.log\tEpoch: [47]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 3981.4518514123833  loss: 0.2494 (0.2545)  time: 0.0419  data: 0.0057  max mem: 281\n",
            "2021/05/21 21:48:11\tINFO\ttorchdistill.misc.log\tEpoch: [47]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 3750.9321036819674  loss: 0.2331 (0.2513)  time: 0.0377  data: 0.0041  max mem: 281\n",
            "2021/05/21 21:48:15\tINFO\ttorchdistill.misc.log\tEpoch: [47] Total time: 0:00:16\n",
            "2021/05/21 21:48:15\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 90.6250 (90.6250)  acc5: 100.0000 (100.0000)  time: 0.5655  data: 0.5338  max mem: 281\n",
            "2021/05/21 21:48:17\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:48:17\tINFO\t__main__\t * Acc@1 86.6400\tAcc@5 99.3100\n",
            "\n",
            "2021/05/21 21:48:18\tINFO\ttorchdistill.misc.log\tEpoch: [48]  [  0/391]  eta: 0:04:41  lr: 0.1  img/s: 1241.1421067962513  loss: 0.3010 (0.3010)  time: 0.7201  data: 0.6169  max mem: 281\n",
            "2021/05/21 21:48:23\tINFO\ttorchdistill.misc.log\tEpoch: [48]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 3371.1824078667278  loss: 0.2274 (0.2343)  time: 0.0417  data: 0.0062  max mem: 281\n",
            "2021/05/21 21:48:27\tINFO\ttorchdistill.misc.log\tEpoch: [48]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 4271.151356038728  loss: 0.2630 (0.2460)  time: 0.0396  data: 0.0049  max mem: 281\n",
            "2021/05/21 21:48:31\tINFO\ttorchdistill.misc.log\tEpoch: [48]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 2976.2833082940188  loss: 0.2773 (0.2491)  time: 0.0399  data: 0.0033  max mem: 281\n",
            "2021/05/21 21:48:34\tINFO\ttorchdistill.misc.log\tEpoch: [48] Total time: 0:00:16\n",
            "2021/05/21 21:48:35\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:45  acc1: 84.3750 (84.3750)  acc5: 100.0000 (100.0000)  time: 0.5801  data: 0.5402  max mem: 281\n",
            "2021/05/21 21:48:37\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:48:37\tINFO\t__main__\t * Acc@1 87.0700\tAcc@5 99.4700\n",
            "\n",
            "2021/05/21 21:48:37\tINFO\ttorchdistill.misc.log\tEpoch: [49]  [  0/391]  eta: 0:04:36  lr: 0.1  img/s: 796.6791297044307  loss: 0.1890 (0.1890)  time: 0.7071  data: 0.5464  max mem: 281\n",
            "2021/05/21 21:48:42\tINFO\ttorchdistill.misc.log\tEpoch: [49]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 3741.9386927248142  loss: 0.2517 (0.2328)  time: 0.0407  data: 0.0052  max mem: 281\n",
            "2021/05/21 21:48:46\tINFO\ttorchdistill.misc.log\tEpoch: [49]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 3986.092927253018  loss: 0.2383 (0.2425)  time: 0.0401  data: 0.0043  max mem: 281\n",
            "2021/05/21 21:48:50\tINFO\ttorchdistill.misc.log\tEpoch: [49]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 5086.3168106715175  loss: 0.2367 (0.2448)  time: 0.0400  data: 0.0039  max mem: 281\n",
            "2021/05/21 21:48:53\tINFO\ttorchdistill.misc.log\tEpoch: [49] Total time: 0:00:16\n",
            "2021/05/21 21:48:54\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:45  acc1: 88.2812 (88.2812)  acc5: 100.0000 (100.0000)  time: 0.5723  data: 0.5416  max mem: 281\n",
            "2021/05/21 21:48:56\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:48:56\tINFO\t__main__\t * Acc@1 86.7600\tAcc@5 99.4300\n",
            "\n",
            "2021/05/21 21:48:57\tINFO\ttorchdistill.misc.log\tEpoch: [50]  [  0/391]  eta: 0:05:41  lr: 0.1  img/s: 1138.1014616566856  loss: 0.2043 (0.2043)  time: 0.8729  data: 0.7604  max mem: 281\n",
            "2021/05/21 21:49:01\tINFO\ttorchdistill.misc.log\tEpoch: [50]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 4482.178946225966  loss: 0.1956 (0.2334)  time: 0.0400  data: 0.0043  max mem: 281\n",
            "2021/05/21 21:49:05\tINFO\ttorchdistill.misc.log\tEpoch: [50]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 4221.546165096639  loss: 0.2922 (0.2447)  time: 0.0392  data: 0.0049  max mem: 281\n",
            "2021/05/21 21:49:09\tINFO\ttorchdistill.misc.log\tEpoch: [50]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 4431.017249632723  loss: 0.2574 (0.2511)  time: 0.0389  data: 0.0041  max mem: 281\n",
            "2021/05/21 21:49:13\tINFO\ttorchdistill.misc.log\tEpoch: [50] Total time: 0:00:16\n",
            "2021/05/21 21:49:13\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 85.9375 (85.9375)  acc5: 99.2188 (99.2188)  time: 0.5570  data: 0.5224  max mem: 281\n",
            "2021/05/21 21:49:15\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:49:15\tINFO\t__main__\t * Acc@1 85.9700\tAcc@5 99.4400\n",
            "\n",
            "2021/05/21 21:49:16\tINFO\ttorchdistill.misc.log\tEpoch: [51]  [  0/391]  eta: 0:04:43  lr: 0.1  img/s: 1051.4881292329146  loss: 0.2105 (0.2105)  time: 0.7242  data: 0.6025  max mem: 281\n",
            "2021/05/21 21:49:21\tINFO\ttorchdistill.misc.log\tEpoch: [51]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 2859.270428461108  loss: 0.2406 (0.2329)  time: 0.0402  data: 0.0049  max mem: 281\n",
            "2021/05/21 21:49:25\tINFO\ttorchdistill.misc.log\tEpoch: [51]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 4087.5176026312583  loss: 0.2439 (0.2448)  time: 0.0402  data: 0.0027  max mem: 281\n",
            "2021/05/21 21:49:29\tINFO\ttorchdistill.misc.log\tEpoch: [51]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 4421.09221470099  loss: 0.2541 (0.2474)  time: 0.0398  data: 0.0049  max mem: 281\n",
            "2021/05/21 21:49:32\tINFO\ttorchdistill.misc.log\tEpoch: [51] Total time: 0:00:16\n",
            "2021/05/21 21:49:33\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:47  acc1: 89.0625 (89.0625)  acc5: 100.0000 (100.0000)  time: 0.5983  data: 0.5643  max mem: 281\n",
            "2021/05/21 21:49:35\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:49:35\tINFO\t__main__\t * Acc@1 87.0100\tAcc@5 99.5700\n",
            "\n",
            "2021/05/21 21:49:36\tINFO\ttorchdistill.misc.log\tEpoch: [52]  [  0/391]  eta: 0:06:23  lr: 0.1  img/s: 998.22416915508  loss: 0.1667 (0.1667)  time: 0.9810  data: 0.8527  max mem: 281\n",
            "2021/05/21 21:49:40\tINFO\ttorchdistill.misc.log\tEpoch: [52]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 4542.900641405337  loss: 0.2443 (0.2446)  time: 0.0409  data: 0.0055  max mem: 281\n",
            "2021/05/21 21:49:44\tINFO\ttorchdistill.misc.log\tEpoch: [52]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 4344.389066014986  loss: 0.2597 (0.2437)  time: 0.0399  data: 0.0060  max mem: 281\n",
            "2021/05/21 21:49:48\tINFO\ttorchdistill.misc.log\tEpoch: [52]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 3121.8870268070013  loss: 0.2638 (0.2495)  time: 0.0409  data: 0.0040  max mem: 281\n",
            "2021/05/21 21:49:51\tINFO\ttorchdistill.misc.log\tEpoch: [52] Total time: 0:00:16\n",
            "2021/05/21 21:49:52\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:46  acc1: 92.1875 (92.1875)  acc5: 98.4375 (98.4375)  time: 0.5874  data: 0.5592  max mem: 281\n",
            "2021/05/21 21:49:54\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:49:54\tINFO\t__main__\t * Acc@1 86.6700\tAcc@5 99.4000\n",
            "\n",
            "2021/05/21 21:49:55\tINFO\ttorchdistill.misc.log\tEpoch: [53]  [  0/391]  eta: 0:06:27  lr: 0.1  img/s: 1025.8235541390563  loss: 0.2713 (0.2713)  time: 0.9919  data: 0.8671  max mem: 281\n",
            "2021/05/21 21:49:59\tINFO\ttorchdistill.misc.log\tEpoch: [53]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 3973.172138184186  loss: 0.2344 (0.2472)  time: 0.0433  data: 0.0049  max mem: 281\n",
            "2021/05/21 21:50:03\tINFO\ttorchdistill.misc.log\tEpoch: [53]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 3121.088469543177  loss: 0.2039 (0.2412)  time: 0.0409  data: 0.0041  max mem: 281\n",
            "2021/05/21 21:50:07\tINFO\ttorchdistill.misc.log\tEpoch: [53]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 5299.183828174352  loss: 0.2351 (0.2419)  time: 0.0390  data: 0.0027  max mem: 281\n",
            "2021/05/21 21:50:11\tINFO\ttorchdistill.misc.log\tEpoch: [53] Total time: 0:00:16\n",
            "2021/05/21 21:50:11\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:43  acc1: 88.2812 (88.2812)  acc5: 100.0000 (100.0000)  time: 0.5452  data: 0.5250  max mem: 281\n",
            "2021/05/21 21:50:13\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:50:13\tINFO\t__main__\t * Acc@1 85.8500\tAcc@5 99.4300\n",
            "\n",
            "2021/05/21 21:50:14\tINFO\ttorchdistill.misc.log\tEpoch: [54]  [  0/391]  eta: 0:04:12  lr: 0.1  img/s: 992.1714411382592  loss: 0.1896 (0.1896)  time: 0.6461  data: 0.5171  max mem: 281\n",
            "2021/05/21 21:50:18\tINFO\ttorchdistill.misc.log\tEpoch: [54]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 4128.696433240537  loss: 0.1879 (0.2266)  time: 0.0411  data: 0.0056  max mem: 281\n",
            "2021/05/21 21:50:22\tINFO\ttorchdistill.misc.log\tEpoch: [54]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 3334.891928490676  loss: 0.2271 (0.2399)  time: 0.0404  data: 0.0048  max mem: 281\n",
            "2021/05/21 21:50:26\tINFO\ttorchdistill.misc.log\tEpoch: [54]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 2734.6586050397054  loss: 0.2837 (0.2486)  time: 0.0394  data: 0.0055  max mem: 281\n",
            "2021/05/21 21:50:30\tINFO\ttorchdistill.misc.log\tEpoch: [54] Total time: 0:00:16\n",
            "2021/05/21 21:50:30\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:49  acc1: 85.9375 (85.9375)  acc5: 100.0000 (100.0000)  time: 0.6293  data: 0.5381  max mem: 281\n",
            "2021/05/21 21:50:32\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:50:32\tINFO\t__main__\t * Acc@1 87.4100\tAcc@5 99.4000\n",
            "\n",
            "2021/05/21 21:50:33\tINFO\ttorchdistill.misc.log\tEpoch: [55]  [  0/391]  eta: 0:05:11  lr: 0.1  img/s: 1076.6379801666483  loss: 0.1953 (0.1953)  time: 0.7975  data: 0.6785  max mem: 281\n",
            "2021/05/21 21:50:37\tINFO\ttorchdistill.misc.log\tEpoch: [55]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 5185.204724789693  loss: 0.2300 (0.2219)  time: 0.0393  data: 0.0049  max mem: 281\n",
            "2021/05/21 21:50:41\tINFO\ttorchdistill.misc.log\tEpoch: [55]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 4161.177128949999  loss: 0.2653 (0.2373)  time: 0.0398  data: 0.0044  max mem: 281\n",
            "2021/05/21 21:50:45\tINFO\ttorchdistill.misc.log\tEpoch: [55]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 5347.90576656805  loss: 0.2230 (0.2417)  time: 0.0388  data: 0.0041  max mem: 281\n",
            "2021/05/21 21:50:49\tINFO\ttorchdistill.misc.log\tEpoch: [55] Total time: 0:00:16\n",
            "2021/05/21 21:50:49\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 86.7188 (86.7188)  acc5: 99.2188 (99.2188)  time: 0.5660  data: 0.5157  max mem: 281\n",
            "2021/05/21 21:50:51\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:50:51\tINFO\t__main__\t * Acc@1 86.1900\tAcc@5 99.3800\n",
            "\n",
            "2021/05/21 21:50:52\tINFO\ttorchdistill.misc.log\tEpoch: [56]  [  0/391]  eta: 0:05:28  lr: 0.1  img/s: 1075.4173241910896  loss: 0.2098 (0.2098)  time: 0.8398  data: 0.7207  max mem: 281\n",
            "2021/05/21 21:50:57\tINFO\ttorchdistill.misc.log\tEpoch: [56]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 4414.766396947569  loss: 0.2163 (0.2255)  time: 0.0403  data: 0.0036  max mem: 281\n",
            "2021/05/21 21:51:01\tINFO\ttorchdistill.misc.log\tEpoch: [56]  [200/391]  eta: 0:00:09  lr: 0.1  img/s: 3365.64531235307  loss: 0.2443 (0.2346)  time: 0.0396  data: 0.0064  max mem: 281\n",
            "2021/05/21 21:51:05\tINFO\ttorchdistill.misc.log\tEpoch: [56]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 3412.8646476975105  loss: 0.2524 (0.2401)  time: 0.0405  data: 0.0046  max mem: 281\n",
            "2021/05/21 21:51:08\tINFO\ttorchdistill.misc.log\tEpoch: [56] Total time: 0:00:17\n",
            "2021/05/21 21:51:09\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:47  acc1: 88.2812 (88.2812)  acc5: 99.2188 (99.2188)  time: 0.6032  data: 0.5714  max mem: 281\n",
            "2021/05/21 21:51:11\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:51:11\tINFO\t__main__\t * Acc@1 85.9000\tAcc@5 99.4600\n",
            "\n",
            "2021/05/21 21:51:12\tINFO\ttorchdistill.misc.log\tEpoch: [57]  [  0/391]  eta: 0:04:47  lr: 0.1  img/s: 1487.712782996647  loss: 0.2605 (0.2605)  time: 0.7359  data: 0.6498  max mem: 281\n",
            "2021/05/21 21:51:16\tINFO\ttorchdistill.misc.log\tEpoch: [57]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 3534.463791014905  loss: 0.2006 (0.2363)  time: 0.0397  data: 0.0050  max mem: 281\n",
            "2021/05/21 21:51:20\tINFO\ttorchdistill.misc.log\tEpoch: [57]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 5502.361480357893  loss: 0.2192 (0.2332)  time: 0.0387  data: 0.0062  max mem: 281\n",
            "2021/05/21 21:51:24\tINFO\ttorchdistill.misc.log\tEpoch: [57]  [300/391]  eta: 0:00:03  lr: 0.1  img/s: 2977.240604464162  loss: 0.2130 (0.2388)  time: 0.0392  data: 0.0050  max mem: 281\n",
            "2021/05/21 21:51:27\tINFO\ttorchdistill.misc.log\tEpoch: [57] Total time: 0:00:16\n",
            "2021/05/21 21:51:28\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:45  acc1: 88.2812 (88.2812)  acc5: 100.0000 (100.0000)  time: 0.5810  data: 0.5616  max mem: 281\n",
            "2021/05/21 21:51:30\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:51:30\tINFO\t__main__\t * Acc@1 87.1600\tAcc@5 99.4000\n",
            "\n",
            "2021/05/21 21:51:30\tINFO\ttorchdistill.misc.log\tEpoch: [58]  [  0/391]  eta: 0:04:07  lr: 0.1  img/s: 1130.00476105282  loss: 0.2863 (0.2863)  time: 0.6324  data: 0.5191  max mem: 281\n",
            "2021/05/21 21:51:35\tINFO\ttorchdistill.misc.log\tEpoch: [58]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 3830.906594739621  loss: 0.2268 (0.2314)  time: 0.0380  data: 0.0045  max mem: 281\n",
            "2021/05/21 21:51:39\tINFO\ttorchdistill.misc.log\tEpoch: [58]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 3455.32364923572  loss: 0.2319 (0.2360)  time: 0.0400  data: 0.0056  max mem: 281\n",
            "2021/05/21 21:51:43\tINFO\ttorchdistill.misc.log\tEpoch: [58]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 3137.357627891212  loss: 0.2717 (0.2410)  time: 0.0406  data: 0.0044  max mem: 281\n",
            "2021/05/21 21:51:47\tINFO\ttorchdistill.misc.log\tEpoch: [58] Total time: 0:00:16\n",
            "2021/05/21 21:51:47\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 86.7188 (86.7188)  acc5: 100.0000 (100.0000)  time: 0.5597  data: 0.5156  max mem: 281\n",
            "2021/05/21 21:51:49\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:51:49\tINFO\t__main__\t * Acc@1 86.0400\tAcc@5 99.2100\n",
            "\n",
            "2021/05/21 21:51:50\tINFO\ttorchdistill.misc.log\tEpoch: [59]  [  0/391]  eta: 0:04:05  lr: 0.1  img/s: 1338.8502371606558  loss: 0.1298 (0.1298)  time: 0.6273  data: 0.5317  max mem: 281\n",
            "2021/05/21 21:51:55\tINFO\ttorchdistill.misc.log\tEpoch: [59]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 4324.024742268041  loss: 0.1822 (0.2139)  time: 0.0396  data: 0.0034  max mem: 281\n",
            "2021/05/21 21:51:59\tINFO\ttorchdistill.misc.log\tEpoch: [59]  [200/391]  eta: 0:00:09  lr: 0.1  img/s: 3048.2206602091683  loss: 0.2578 (0.2311)  time: 0.0416  data: 0.0040  max mem: 281\n",
            "2021/05/21 21:52:03\tINFO\ttorchdistill.misc.log\tEpoch: [59]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 3803.7643791359055  loss: 0.2259 (0.2382)  time: 0.0418  data: 0.0053  max mem: 281\n",
            "2021/05/21 21:52:06\tINFO\ttorchdistill.misc.log\tEpoch: [59] Total time: 0:00:16\n",
            "2021/05/21 21:52:07\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:45  acc1: 89.0625 (89.0625)  acc5: 99.2188 (99.2188)  time: 0.5805  data: 0.5428  max mem: 281\n",
            "2021/05/21 21:52:09\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:52:09\tINFO\t__main__\t * Acc@1 86.2600\tAcc@5 99.4700\n",
            "\n",
            "2021/05/21 21:52:09\tINFO\ttorchdistill.misc.log\tEpoch: [60]  [  0/391]  eta: 0:05:11  lr: 0.1  img/s: 1095.7958104817558  loss: 0.2673 (0.2673)  time: 0.7970  data: 0.6802  max mem: 281\n",
            "2021/05/21 21:52:14\tINFO\ttorchdistill.misc.log\tEpoch: [60]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 2220.346540058562  loss: 0.2105 (0.2258)  time: 0.0420  data: 0.0051  max mem: 281\n",
            "2021/05/21 21:52:18\tINFO\ttorchdistill.misc.log\tEpoch: [60]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 3909.121379370604  loss: 0.2284 (0.2352)  time: 0.0374  data: 0.0042  max mem: 281\n",
            "2021/05/21 21:52:22\tINFO\ttorchdistill.misc.log\tEpoch: [60]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 3315.5939057453234  loss: 0.2350 (0.2421)  time: 0.0387  data: 0.0041  max mem: 281\n",
            "2021/05/21 21:52:25\tINFO\ttorchdistill.misc.log\tEpoch: [60] Total time: 0:00:16\n",
            "2021/05/21 21:52:26\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:45  acc1: 87.5000 (87.5000)  acc5: 100.0000 (100.0000)  time: 0.5809  data: 0.5319  max mem: 281\n",
            "2021/05/21 21:52:28\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:52:28\tINFO\t__main__\t * Acc@1 86.3300\tAcc@5 99.4500\n",
            "\n",
            "2021/05/21 21:52:28\tINFO\ttorchdistill.misc.log\tEpoch: [61]  [  0/391]  eta: 0:04:29  lr: 0.1  img/s: 988.9438450613679  loss: 0.1678 (0.1678)  time: 0.6893  data: 0.5599  max mem: 281\n",
            "2021/05/21 21:52:33\tINFO\ttorchdistill.misc.log\tEpoch: [61]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 4321.657854911936  loss: 0.2294 (0.2194)  time: 0.0400  data: 0.0050  max mem: 281\n",
            "2021/05/21 21:52:37\tINFO\ttorchdistill.misc.log\tEpoch: [61]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 3745.541329463638  loss: 0.2162 (0.2313)  time: 0.0385  data: 0.0042  max mem: 281\n",
            "2021/05/21 21:52:41\tINFO\ttorchdistill.misc.log\tEpoch: [61]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 2416.6175064593667  loss: 0.2253 (0.2325)  time: 0.0401  data: 0.0036  max mem: 281\n",
            "2021/05/21 21:52:44\tINFO\ttorchdistill.misc.log\tEpoch: [61] Total time: 0:00:16\n",
            "2021/05/21 21:52:45\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:49  acc1: 91.4062 (91.4062)  acc5: 100.0000 (100.0000)  time: 0.6312  data: 0.5965  max mem: 281\n",
            "2021/05/21 21:52:47\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:52:47\tINFO\t__main__\t * Acc@1 87.1300\tAcc@5 99.4600\n",
            "\n",
            "2021/05/21 21:52:48\tINFO\ttorchdistill.misc.log\tEpoch: [62]  [  0/391]  eta: 0:05:53  lr: 0.1  img/s: 1176.4816100417236  loss: 0.1676 (0.1676)  time: 0.9046  data: 0.7958  max mem: 281\n",
            "2021/05/21 21:52:52\tINFO\ttorchdistill.misc.log\tEpoch: [62]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 2790.72296584311  loss: 0.2230 (0.2190)  time: 0.0377  data: 0.0037  max mem: 281\n",
            "2021/05/21 21:52:56\tINFO\ttorchdistill.misc.log\tEpoch: [62]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 3928.745367795568  loss: 0.2352 (0.2287)  time: 0.0377  data: 0.0047  max mem: 281\n",
            "2021/05/21 21:53:00\tINFO\ttorchdistill.misc.log\tEpoch: [62]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 3821.19967544022  loss: 0.2230 (0.2335)  time: 0.0434  data: 0.0052  max mem: 281\n",
            "2021/05/21 21:53:04\tINFO\ttorchdistill.misc.log\tEpoch: [62] Total time: 0:00:16\n",
            "2021/05/21 21:53:04\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:43  acc1: 86.7188 (86.7188)  acc5: 100.0000 (100.0000)  time: 0.5556  data: 0.5277  max mem: 281\n",
            "2021/05/21 21:53:06\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:53:06\tINFO\t__main__\t * Acc@1 86.7100\tAcc@5 99.4500\n",
            "\n",
            "2021/05/21 21:53:07\tINFO\ttorchdistill.misc.log\tEpoch: [63]  [  0/391]  eta: 0:06:27  lr: 0.1  img/s: 923.1803420199641  loss: 0.2487 (0.2487)  time: 0.9918  data: 0.8531  max mem: 281\n",
            "2021/05/21 21:53:12\tINFO\ttorchdistill.misc.log\tEpoch: [63]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 3218.9014251710264  loss: 0.2050 (0.2315)  time: 0.0415  data: 0.0053  max mem: 281\n",
            "2021/05/21 21:53:16\tINFO\ttorchdistill.misc.log\tEpoch: [63]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 3295.78941164915  loss: 0.2115 (0.2248)  time: 0.0399  data: 0.0033  max mem: 281\n",
            "2021/05/21 21:53:20\tINFO\ttorchdistill.misc.log\tEpoch: [63]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 4028.8383499553493  loss: 0.2497 (0.2338)  time: 0.0397  data: 0.0038  max mem: 281\n",
            "2021/05/21 21:53:23\tINFO\ttorchdistill.misc.log\tEpoch: [63] Total time: 0:00:16\n",
            "2021/05/21 21:53:24\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:46  acc1: 85.1562 (85.1562)  acc5: 100.0000 (100.0000)  time: 0.5850  data: 0.5527  max mem: 281\n",
            "2021/05/21 21:53:25\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:53:25\tINFO\t__main__\t * Acc@1 85.2000\tAcc@5 99.4100\n",
            "\n",
            "2021/05/21 21:53:26\tINFO\ttorchdistill.misc.log\tEpoch: [64]  [  0/391]  eta: 0:04:15  lr: 0.1  img/s: 1182.0611825215442  loss: 0.1782 (0.1782)  time: 0.6542  data: 0.5459  max mem: 281\n",
            "2021/05/21 21:53:31\tINFO\ttorchdistill.misc.log\tEpoch: [64]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 3444.947235358662  loss: 0.2329 (0.2175)  time: 0.0398  data: 0.0041  max mem: 281\n",
            "2021/05/21 21:53:35\tINFO\ttorchdistill.misc.log\tEpoch: [64]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 4015.3991458680807  loss: 0.2111 (0.2302)  time: 0.0421  data: 0.0044  max mem: 281\n",
            "2021/05/21 21:53:39\tINFO\ttorchdistill.misc.log\tEpoch: [64]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 4010.9592905544223  loss: 0.2607 (0.2323)  time: 0.0389  data: 0.0046  max mem: 281\n",
            "2021/05/21 21:53:42\tINFO\ttorchdistill.misc.log\tEpoch: [64] Total time: 0:00:16\n",
            "2021/05/21 21:53:43\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 86.7188 (86.7188)  acc5: 99.2188 (99.2188)  time: 0.5694  data: 0.5406  max mem: 281\n",
            "2021/05/21 21:53:45\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:53:45\tINFO\t__main__\t * Acc@1 85.1600\tAcc@5 99.3000\n",
            "\n",
            "2021/05/21 21:53:45\tINFO\ttorchdistill.misc.log\tEpoch: [65]  [  0/391]  eta: 0:05:24  lr: 0.1  img/s: 1087.6044300656163  loss: 0.1549 (0.1549)  time: 0.8299  data: 0.7122  max mem: 281\n",
            "2021/05/21 21:53:50\tINFO\ttorchdistill.misc.log\tEpoch: [65]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 3997.9365984793762  loss: 0.2085 (0.2306)  time: 0.0395  data: 0.0045  max mem: 281\n",
            "2021/05/21 21:53:54\tINFO\ttorchdistill.misc.log\tEpoch: [65]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 5133.6888446900875  loss: 0.2509 (0.2304)  time: 0.0385  data: 0.0045  max mem: 281\n",
            "2021/05/21 21:53:58\tINFO\ttorchdistill.misc.log\tEpoch: [65]  [300/391]  eta: 0:00:03  lr: 0.1  img/s: 3800.3717190021803  loss: 0.2422 (0.2342)  time: 0.0389  data: 0.0050  max mem: 281\n",
            "2021/05/21 21:54:01\tINFO\ttorchdistill.misc.log\tEpoch: [65] Total time: 0:00:16\n",
            "2021/05/21 21:54:02\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:47  acc1: 89.8438 (89.8438)  acc5: 100.0000 (100.0000)  time: 0.5993  data: 0.5481  max mem: 281\n",
            "2021/05/21 21:54:03\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:54:03\tINFO\t__main__\t * Acc@1 86.1800\tAcc@5 99.5000\n",
            "\n",
            "2021/05/21 21:54:04\tINFO\ttorchdistill.misc.log\tEpoch: [66]  [  0/391]  eta: 0:05:13  lr: 0.1  img/s: 1058.649713681753  loss: 0.1704 (0.1704)  time: 0.8014  data: 0.6805  max mem: 281\n",
            "2021/05/21 21:54:09\tINFO\ttorchdistill.misc.log\tEpoch: [66]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 3302.6015748031496  loss: 0.2253 (0.2221)  time: 0.0403  data: 0.0046  max mem: 281\n",
            "2021/05/21 21:54:13\tINFO\ttorchdistill.misc.log\tEpoch: [66]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 3225.4766502249963  loss: 0.2463 (0.2305)  time: 0.0408  data: 0.0050  max mem: 281\n",
            "2021/05/21 21:54:17\tINFO\ttorchdistill.misc.log\tEpoch: [66]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 4151.267036272395  loss: 0.2152 (0.2318)  time: 0.0398  data: 0.0046  max mem: 281\n",
            "2021/05/21 21:54:20\tINFO\ttorchdistill.misc.log\tEpoch: [66] Total time: 0:00:16\n",
            "2021/05/21 21:54:21\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 90.6250 (90.6250)  acc5: 99.2188 (99.2188)  time: 0.5694  data: 0.5301  max mem: 281\n",
            "2021/05/21 21:54:23\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:54:23\tINFO\t__main__\t * Acc@1 87.8200\tAcc@5 99.5300\n",
            "\n",
            "2021/05/21 21:54:23\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 87.6100 -> 87.8200)\n",
            "2021/05/21 21:54:24\tINFO\ttorchdistill.misc.log\tEpoch: [67]  [  0/391]  eta: 0:05:01  lr: 0.1  img/s: 936.1355194534583  loss: 0.2210 (0.2210)  time: 0.7706  data: 0.6339  max mem: 281\n",
            "2021/05/21 21:54:28\tINFO\ttorchdistill.misc.log\tEpoch: [67]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 2926.7159040111646  loss: 0.2251 (0.2207)  time: 0.0388  data: 0.0035  max mem: 281\n",
            "2021/05/21 21:54:32\tINFO\ttorchdistill.misc.log\tEpoch: [67]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 3765.242814862609  loss: 0.2647 (0.2260)  time: 0.0404  data: 0.0043  max mem: 281\n",
            "2021/05/21 21:54:36\tINFO\ttorchdistill.misc.log\tEpoch: [67]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 3921.3418450076692  loss: 0.1873 (0.2301)  time: 0.0395  data: 0.0035  max mem: 281\n",
            "2021/05/21 21:54:40\tINFO\ttorchdistill.misc.log\tEpoch: [67] Total time: 0:00:16\n",
            "2021/05/21 21:54:40\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:50  acc1: 89.0625 (89.0625)  acc5: 98.4375 (98.4375)  time: 0.6343  data: 0.6097  max mem: 281\n",
            "2021/05/21 21:54:42\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:54:42\tINFO\t__main__\t * Acc@1 85.1100\tAcc@5 99.3800\n",
            "\n",
            "2021/05/21 21:54:43\tINFO\ttorchdistill.misc.log\tEpoch: [68]  [  0/391]  eta: 0:05:26  lr: 0.1  img/s: 1089.3500312477172  loss: 0.1726 (0.1726)  time: 0.8349  data: 0.7173  max mem: 281\n",
            "2021/05/21 21:54:47\tINFO\ttorchdistill.misc.log\tEpoch: [68]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 5571.627804645177  loss: 0.1915 (0.2338)  time: 0.0381  data: 0.0052  max mem: 281\n",
            "2021/05/21 21:54:51\tINFO\ttorchdistill.misc.log\tEpoch: [68]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 3455.123513360449  loss: 0.2480 (0.2297)  time: 0.0408  data: 0.0045  max mem: 281\n",
            "2021/05/21 21:54:55\tINFO\ttorchdistill.misc.log\tEpoch: [68]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 3764.5563627184247  loss: 0.2345 (0.2339)  time: 0.0405  data: 0.0070  max mem: 281\n",
            "2021/05/21 21:54:59\tINFO\ttorchdistill.misc.log\tEpoch: [68] Total time: 0:00:16\n",
            "2021/05/21 21:54:59\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:46  acc1: 88.2812 (88.2812)  acc5: 100.0000 (100.0000)  time: 0.5868  data: 0.5484  max mem: 281\n",
            "2021/05/21 21:55:01\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:55:01\tINFO\t__main__\t * Acc@1 85.9600\tAcc@5 99.2100\n",
            "\n",
            "2021/05/21 21:55:02\tINFO\ttorchdistill.misc.log\tEpoch: [69]  [  0/391]  eta: 0:05:36  lr: 0.1  img/s: 1179.3943265620846  loss: 0.1683 (0.1683)  time: 0.8597  data: 0.7511  max mem: 281\n",
            "2021/05/21 21:55:06\tINFO\ttorchdistill.misc.log\tEpoch: [69]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 3144.561073039302  loss: 0.2019 (0.2156)  time: 0.0371  data: 0.0046  max mem: 281\n",
            "2021/05/21 21:55:10\tINFO\ttorchdistill.misc.log\tEpoch: [69]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 2667.7610860448012  loss: 0.2042 (0.2256)  time: 0.0399  data: 0.0041  max mem: 281\n",
            "2021/05/21 21:55:14\tINFO\ttorchdistill.misc.log\tEpoch: [69]  [300/391]  eta: 0:00:03  lr: 0.1  img/s: 5330.224896249081  loss: 0.2239 (0.2294)  time: 0.0389  data: 0.0056  max mem: 281\n",
            "2021/05/21 21:55:18\tINFO\ttorchdistill.misc.log\tEpoch: [69] Total time: 0:00:16\n",
            "2021/05/21 21:55:18\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:58  acc1: 91.4062 (91.4062)  acc5: 100.0000 (100.0000)  time: 0.7464  data: 0.7289  max mem: 281\n",
            "2021/05/21 21:55:20\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:55:20\tINFO\t__main__\t * Acc@1 88.2000\tAcc@5 99.5900\n",
            "\n",
            "2021/05/21 21:55:20\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 87.8200 -> 88.2000)\n",
            "2021/05/21 21:55:21\tINFO\ttorchdistill.misc.log\tEpoch: [70]  [  0/391]  eta: 0:06:30  lr: 0.1  img/s: 911.8842019264576  loss: 0.1781 (0.1781)  time: 1.0000  data: 0.8596  max mem: 281\n",
            "2021/05/21 21:55:26\tINFO\ttorchdistill.misc.log\tEpoch: [70]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 4074.3339632235197  loss: 0.2159 (0.2050)  time: 0.0399  data: 0.0046  max mem: 281\n",
            "2021/05/21 21:55:29\tINFO\ttorchdistill.misc.log\tEpoch: [70]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 3834.134948294578  loss: 0.2152 (0.2131)  time: 0.0382  data: 0.0056  max mem: 281\n",
            "2021/05/21 21:55:33\tINFO\ttorchdistill.misc.log\tEpoch: [70]  [300/391]  eta: 0:00:03  lr: 0.1  img/s: 5213.199382422342  loss: 0.2131 (0.2234)  time: 0.0388  data: 0.0037  max mem: 281\n",
            "2021/05/21 21:55:37\tINFO\ttorchdistill.misc.log\tEpoch: [70] Total time: 0:00:16\n",
            "2021/05/21 21:55:37\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:52  acc1: 88.2812 (88.2812)  acc5: 100.0000 (100.0000)  time: 0.6694  data: 0.6362  max mem: 281\n",
            "2021/05/21 21:55:39\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:55:39\tINFO\t__main__\t * Acc@1 86.5800\tAcc@5 99.4100\n",
            "\n",
            "2021/05/21 21:55:40\tINFO\ttorchdistill.misc.log\tEpoch: [71]  [  0/391]  eta: 0:06:46  lr: 0.1  img/s: 1086.3961665479505  loss: 0.1491 (0.1491)  time: 1.0387  data: 0.9208  max mem: 281\n",
            "2021/05/21 21:55:45\tINFO\ttorchdistill.misc.log\tEpoch: [71]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 4000.051499076116  loss: 0.1964 (0.2167)  time: 0.0406  data: 0.0057  max mem: 281\n",
            "2021/05/21 21:55:49\tINFO\ttorchdistill.misc.log\tEpoch: [71]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 2688.6160163859718  loss: 0.2186 (0.2198)  time: 0.0416  data: 0.0049  max mem: 281\n",
            "2021/05/21 21:55:53\tINFO\ttorchdistill.misc.log\tEpoch: [71]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 3757.10075230064  loss: 0.2027 (0.2220)  time: 0.0375  data: 0.0044  max mem: 281\n",
            "2021/05/21 21:55:56\tINFO\ttorchdistill.misc.log\tEpoch: [71] Total time: 0:00:16\n",
            "2021/05/21 21:55:57\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:45  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5783  data: 0.5458  max mem: 281\n",
            "2021/05/21 21:55:59\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:55:59\tINFO\t__main__\t * Acc@1 86.7700\tAcc@5 99.5900\n",
            "\n",
            "2021/05/21 21:55:59\tINFO\ttorchdistill.misc.log\tEpoch: [72]  [  0/391]  eta: 0:06:17  lr: 0.1  img/s: 1066.5087615789714  loss: 0.1462 (0.1462)  time: 0.9665  data: 0.8464  max mem: 281\n",
            "2021/05/21 21:56:04\tINFO\ttorchdistill.misc.log\tEpoch: [72]  [100/391]  eta: 0:00:16  lr: 0.1  img/s: 3705.5991606904977  loss: 0.2293 (0.2303)  time: 0.0410  data: 0.0053  max mem: 281\n",
            "2021/05/21 21:56:09\tINFO\ttorchdistill.misc.log\tEpoch: [72]  [200/391]  eta: 0:00:09  lr: 0.1  img/s: 2357.1161279558846  loss: 0.2240 (0.2222)  time: 0.0466  data: 0.0044  max mem: 281\n",
            "2021/05/21 21:56:13\tINFO\ttorchdistill.misc.log\tEpoch: [72]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 4063.694324598453  loss: 0.2306 (0.2210)  time: 0.0408  data: 0.0051  max mem: 281\n",
            "2021/05/21 21:56:16\tINFO\ttorchdistill.misc.log\tEpoch: [72] Total time: 0:00:17\n",
            "2021/05/21 21:56:17\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:49  acc1: 89.8438 (89.8438)  acc5: 100.0000 (100.0000)  time: 0.6212  data: 0.6089  max mem: 281\n",
            "2021/05/21 21:56:19\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:56:19\tINFO\t__main__\t * Acc@1 87.2800\tAcc@5 99.4400\n",
            "\n",
            "2021/05/21 21:56:20\tINFO\ttorchdistill.misc.log\tEpoch: [73]  [  0/391]  eta: 0:06:28  lr: 0.1  img/s: 873.2831663069132  loss: 0.1815 (0.1815)  time: 0.9932  data: 0.8466  max mem: 281\n",
            "2021/05/21 21:56:25\tINFO\ttorchdistill.misc.log\tEpoch: [73]  [100/391]  eta: 0:00:16  lr: 0.1  img/s: 3260.9173580825814  loss: 0.1912 (0.2069)  time: 0.0437  data: 0.0047  max mem: 281\n",
            "2021/05/21 21:56:29\tINFO\ttorchdistill.misc.log\tEpoch: [73]  [200/391]  eta: 0:00:09  lr: 0.1  img/s: 3048.982360491135  loss: 0.2283 (0.2131)  time: 0.0429  data: 0.0044  max mem: 281\n",
            "2021/05/21 21:56:33\tINFO\ttorchdistill.misc.log\tEpoch: [73]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 3199.6216267760083  loss: 0.2307 (0.2216)  time: 0.0405  data: 0.0042  max mem: 281\n",
            "2021/05/21 21:56:37\tINFO\ttorchdistill.misc.log\tEpoch: [73] Total time: 0:00:17\n",
            "2021/05/21 21:56:37\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:49  acc1: 78.9062 (78.9062)  acc5: 99.2188 (99.2188)  time: 0.6321  data: 0.6012  max mem: 281\n",
            "2021/05/21 21:56:39\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:56:39\tINFO\t__main__\t * Acc@1 84.5600\tAcc@5 99.4200\n",
            "\n",
            "2021/05/21 21:56:40\tINFO\ttorchdistill.misc.log\tEpoch: [74]  [  0/391]  eta: 0:06:17  lr: 0.1  img/s: 1194.7536413141445  loss: 0.2312 (0.2312)  time: 0.9646  data: 0.8575  max mem: 281\n",
            "2021/05/21 21:56:45\tINFO\ttorchdistill.misc.log\tEpoch: [74]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 4069.6394963652488  loss: 0.2105 (0.2160)  time: 0.0400  data: 0.0060  max mem: 281\n",
            "2021/05/21 21:56:49\tINFO\ttorchdistill.misc.log\tEpoch: [74]  [200/391]  eta: 0:00:09  lr: 0.1  img/s: 2951.0400492507943  loss: 0.2114 (0.2229)  time: 0.0423  data: 0.0055  max mem: 281\n",
            "2021/05/21 21:56:53\tINFO\ttorchdistill.misc.log\tEpoch: [74]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 3458.551259421504  loss: 0.2455 (0.2289)  time: 0.0395  data: 0.0042  max mem: 281\n",
            "2021/05/21 21:56:56\tINFO\ttorchdistill.misc.log\tEpoch: [74] Total time: 0:00:17\n",
            "2021/05/21 21:56:57\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:47  acc1: 88.2812 (88.2812)  acc5: 99.2188 (99.2188)  time: 0.5963  data: 0.5383  max mem: 281\n",
            "2021/05/21 21:56:59\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:56:59\tINFO\t__main__\t * Acc@1 85.0300\tAcc@5 99.3800\n",
            "\n",
            "2021/05/21 21:57:00\tINFO\ttorchdistill.misc.log\tEpoch: [75]  [  0/391]  eta: 0:04:58  lr: 0.1  img/s: 1111.4879549501056  loss: 0.2901 (0.2901)  time: 0.7624  data: 0.6472  max mem: 281\n",
            "2021/05/21 21:57:04\tINFO\ttorchdistill.misc.log\tEpoch: [75]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 3122.195669746966  loss: 0.1920 (0.2162)  time: 0.0406  data: 0.0061  max mem: 281\n",
            "2021/05/21 21:57:08\tINFO\ttorchdistill.misc.log\tEpoch: [75]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 5274.402797972256  loss: 0.2063 (0.2272)  time: 0.0386  data: 0.0039  max mem: 281\n",
            "2021/05/21 21:57:12\tINFO\ttorchdistill.misc.log\tEpoch: [75]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 4383.478493745713  loss: 0.2310 (0.2236)  time: 0.0399  data: 0.0041  max mem: 281\n",
            "2021/05/21 21:57:16\tINFO\ttorchdistill.misc.log\tEpoch: [75] Total time: 0:00:16\n",
            "2021/05/21 21:57:16\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:45  acc1: 85.1562 (85.1562)  acc5: 99.2188 (99.2188)  time: 0.5758  data: 0.5419  max mem: 281\n",
            "2021/05/21 21:57:18\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:57:18\tINFO\t__main__\t * Acc@1 86.0600\tAcc@5 99.4500\n",
            "\n",
            "2021/05/21 21:57:19\tINFO\ttorchdistill.misc.log\tEpoch: [76]  [  0/391]  eta: 0:04:10  lr: 0.1  img/s: 1031.2541529004993  loss: 0.2857 (0.2857)  time: 0.6416  data: 0.5174  max mem: 281\n",
            "2021/05/21 21:57:24\tINFO\ttorchdistill.misc.log\tEpoch: [76]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 3454.990102323187  loss: 0.2019 (0.2156)  time: 0.0407  data: 0.0027  max mem: 281\n",
            "2021/05/21 21:57:28\tINFO\ttorchdistill.misc.log\tEpoch: [76]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 3067.0801574470274  loss: 0.2172 (0.2226)  time: 0.0401  data: 0.0050  max mem: 281\n",
            "2021/05/21 21:57:32\tINFO\ttorchdistill.misc.log\tEpoch: [76]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 2913.327537836239  loss: 0.2071 (0.2261)  time: 0.0388  data: 0.0033  max mem: 281\n",
            "2021/05/21 21:57:35\tINFO\ttorchdistill.misc.log\tEpoch: [76] Total time: 0:00:16\n",
            "2021/05/21 21:57:36\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:48  acc1: 85.9375 (85.9375)  acc5: 100.0000 (100.0000)  time: 0.6147  data: 0.5917  max mem: 281\n",
            "2021/05/21 21:57:38\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:57:38\tINFO\t__main__\t * Acc@1 82.7100\tAcc@5 99.2000\n",
            "\n",
            "2021/05/21 21:57:38\tINFO\ttorchdistill.misc.log\tEpoch: [77]  [  0/391]  eta: 0:04:14  lr: 0.1  img/s: 1239.0110268493859  loss: 0.2308 (0.2308)  time: 0.6517  data: 0.5483  max mem: 281\n",
            "2021/05/21 21:57:43\tINFO\ttorchdistill.misc.log\tEpoch: [77]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 2891.143606451439  loss: 0.2047 (0.2151)  time: 0.0384  data: 0.0023  max mem: 281\n",
            "2021/05/21 21:57:47\tINFO\ttorchdistill.misc.log\tEpoch: [77]  [200/391]  eta: 0:00:09  lr: 0.1  img/s: 4307.856402355848  loss: 0.2344 (0.2207)  time: 0.0415  data: 0.0057  max mem: 281\n",
            "2021/05/21 21:57:51\tINFO\ttorchdistill.misc.log\tEpoch: [77]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 3709.952332580108  loss: 0.2154 (0.2239)  time: 0.0405  data: 0.0053  max mem: 281\n",
            "2021/05/21 21:57:55\tINFO\ttorchdistill.misc.log\tEpoch: [77] Total time: 0:00:17\n",
            "2021/05/21 21:57:55\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:47  acc1: 88.2812 (88.2812)  acc5: 100.0000 (100.0000)  time: 0.5986  data: 0.5542  max mem: 281\n",
            "2021/05/21 21:57:57\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:57:57\tINFO\t__main__\t * Acc@1 87.8800\tAcc@5 99.4900\n",
            "\n",
            "2021/05/21 21:57:58\tINFO\ttorchdistill.misc.log\tEpoch: [78]  [  0/391]  eta: 0:04:15  lr: 0.1  img/s: 1201.499688922508  loss: 0.1340 (0.1340)  time: 0.6532  data: 0.5466  max mem: 281\n",
            "2021/05/21 21:58:03\tINFO\ttorchdistill.misc.log\tEpoch: [78]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 3390.9635431141205  loss: 0.2160 (0.2199)  time: 0.0389  data: 0.0047  max mem: 281\n",
            "2021/05/21 21:58:07\tINFO\ttorchdistill.misc.log\tEpoch: [78]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 3525.4584329279505  loss: 0.2335 (0.2210)  time: 0.0388  data: 0.0047  max mem: 281\n",
            "2021/05/21 21:58:11\tINFO\ttorchdistill.misc.log\tEpoch: [78]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 3105.9392200308935  loss: 0.2347 (0.2244)  time: 0.0412  data: 0.0046  max mem: 281\n",
            "2021/05/21 21:58:14\tINFO\ttorchdistill.misc.log\tEpoch: [78] Total time: 0:00:16\n",
            "2021/05/21 21:58:15\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:45  acc1: 88.2812 (88.2812)  acc5: 100.0000 (100.0000)  time: 0.5772  data: 0.5416  max mem: 281\n",
            "2021/05/21 21:58:17\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:58:17\tINFO\t__main__\t * Acc@1 84.1800\tAcc@5 99.2200\n",
            "\n",
            "2021/05/21 21:58:18\tINFO\ttorchdistill.misc.log\tEpoch: [79]  [  0/391]  eta: 0:05:35  lr: 0.1  img/s: 1165.8915612153378  loss: 0.2026 (0.2026)  time: 0.8568  data: 0.7470  max mem: 281\n",
            "2021/05/21 21:58:22\tINFO\ttorchdistill.misc.log\tEpoch: [79]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 4278.571808828569  loss: 0.2128 (0.2094)  time: 0.0419  data: 0.0037  max mem: 281\n",
            "2021/05/21 21:58:26\tINFO\ttorchdistill.misc.log\tEpoch: [79]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 4234.331666535216  loss: 0.1891 (0.2129)  time: 0.0389  data: 0.0043  max mem: 281\n",
            "2021/05/21 21:58:30\tINFO\ttorchdistill.misc.log\tEpoch: [79]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 3200.2510267705456  loss: 0.2384 (0.2198)  time: 0.0421  data: 0.0044  max mem: 281\n",
            "2021/05/21 21:58:33\tINFO\ttorchdistill.misc.log\tEpoch: [79] Total time: 0:00:16\n",
            "2021/05/21 21:58:34\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:49  acc1: 85.1562 (85.1562)  acc5: 100.0000 (100.0000)  time: 0.6278  data: 0.5890  max mem: 281\n",
            "2021/05/21 21:58:36\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:58:36\tINFO\t__main__\t * Acc@1 83.8900\tAcc@5 99.3100\n",
            "\n",
            "2021/05/21 21:58:37\tINFO\ttorchdistill.misc.log\tEpoch: [80]  [  0/391]  eta: 0:04:42  lr: 0.1  img/s: 1244.1592999515658  loss: 0.2480 (0.2480)  time: 0.7216  data: 0.6187  max mem: 281\n",
            "2021/05/21 21:58:41\tINFO\ttorchdistill.misc.log\tEpoch: [80]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 3329.0397534554068  loss: 0.2526 (0.2146)  time: 0.0399  data: 0.0035  max mem: 281\n",
            "2021/05/21 21:58:45\tINFO\ttorchdistill.misc.log\tEpoch: [80]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 4136.043943514403  loss: 0.2064 (0.2182)  time: 0.0396  data: 0.0030  max mem: 281\n",
            "2021/05/21 21:58:49\tINFO\ttorchdistill.misc.log\tEpoch: [80]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 3066.975029848785  loss: 0.2100 (0.2217)  time: 0.0404  data: 0.0058  max mem: 281\n",
            "2021/05/21 21:58:53\tINFO\ttorchdistill.misc.log\tEpoch: [80] Total time: 0:00:16\n",
            "2021/05/21 21:58:53\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:45  acc1: 87.5000 (87.5000)  acc5: 99.2188 (99.2188)  time: 0.5772  data: 0.5496  max mem: 281\n",
            "2021/05/21 21:58:55\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:58:55\tINFO\t__main__\t * Acc@1 86.4000\tAcc@5 99.4300\n",
            "\n",
            "2021/05/21 21:58:56\tINFO\ttorchdistill.misc.log\tEpoch: [81]  [  0/391]  eta: 0:04:25  lr: 0.1  img/s: 984.3365076804042  loss: 0.1599 (0.1599)  time: 0.6792  data: 0.5491  max mem: 281\n",
            "2021/05/21 21:59:01\tINFO\ttorchdistill.misc.log\tEpoch: [81]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 3176.976542713092  loss: 0.1867 (0.2113)  time: 0.0409  data: 0.0061  max mem: 281\n",
            "2021/05/21 21:59:05\tINFO\ttorchdistill.misc.log\tEpoch: [81]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 3090.6872071200764  loss: 0.2162 (0.2194)  time: 0.0417  data: 0.0055  max mem: 281\n",
            "2021/05/21 21:59:08\tINFO\ttorchdistill.misc.log\tEpoch: [81]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 4040.4816027334373  loss: 0.2129 (0.2240)  time: 0.0372  data: 0.0031  max mem: 281\n",
            "2021/05/21 21:59:12\tINFO\ttorchdistill.misc.log\tEpoch: [81] Total time: 0:00:16\n",
            "2021/05/21 21:59:13\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:45  acc1: 92.9688 (92.9688)  acc5: 100.0000 (100.0000)  time: 0.5799  data: 0.5317  max mem: 281\n",
            "2021/05/21 21:59:14\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:59:14\tINFO\t__main__\t * Acc@1 88.0900\tAcc@5 99.4300\n",
            "\n",
            "2021/05/21 21:59:15\tINFO\ttorchdistill.misc.log\tEpoch: [82]  [  0/391]  eta: 0:05:45  lr: 0.1  img/s: 1089.2218448591382  loss: 0.1876 (0.1876)  time: 0.8844  data: 0.7668  max mem: 281\n",
            "2021/05/21 21:59:20\tINFO\ttorchdistill.misc.log\tEpoch: [82]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 2341.0817438929735  loss: 0.2096 (0.2088)  time: 0.0401  data: 0.0042  max mem: 281\n",
            "2021/05/21 21:59:24\tINFO\ttorchdistill.misc.log\tEpoch: [82]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 2206.6936520724066  loss: 0.1985 (0.2118)  time: 0.0387  data: 0.0034  max mem: 281\n",
            "2021/05/21 21:59:28\tINFO\ttorchdistill.misc.log\tEpoch: [82]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 2926.7956801666005  loss: 0.2082 (0.2149)  time: 0.0389  data: 0.0040  max mem: 281\n",
            "2021/05/21 21:59:31\tINFO\ttorchdistill.misc.log\tEpoch: [82] Total time: 0:00:16\n",
            "2021/05/21 21:59:32\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:43  acc1: 90.6250 (90.6250)  acc5: 100.0000 (100.0000)  time: 0.5550  data: 0.5144  max mem: 281\n",
            "2021/05/21 21:59:34\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:59:34\tINFO\t__main__\t * Acc@1 86.9300\tAcc@5 99.5000\n",
            "\n",
            "2021/05/21 21:59:35\tINFO\ttorchdistill.misc.log\tEpoch: [83]  [  0/391]  eta: 0:05:48  lr: 0.1  img/s: 1009.5277809117645  loss: 0.2328 (0.2328)  time: 0.8906  data: 0.7638  max mem: 281\n",
            "2021/05/21 21:59:39\tINFO\ttorchdistill.misc.log\tEpoch: [83]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 4310.554260204901  loss: 0.2045 (0.2172)  time: 0.0401  data: 0.0043  max mem: 281\n",
            "2021/05/21 21:59:43\tINFO\ttorchdistill.misc.log\tEpoch: [83]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 2921.142359675278  loss: 0.1900 (0.2152)  time: 0.0390  data: 0.0042  max mem: 281\n",
            "2021/05/21 21:59:47\tINFO\ttorchdistill.misc.log\tEpoch: [83]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 3396.82072242504  loss: 0.2291 (0.2218)  time: 0.0377  data: 0.0056  max mem: 281\n",
            "2021/05/21 21:59:50\tINFO\ttorchdistill.misc.log\tEpoch: [83] Total time: 0:00:16\n",
            "2021/05/21 21:59:51\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:45  acc1: 90.6250 (90.6250)  acc5: 100.0000 (100.0000)  time: 0.5705  data: 0.5419  max mem: 281\n",
            "2021/05/21 21:59:53\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 21:59:53\tINFO\t__main__\t * Acc@1 86.3300\tAcc@5 99.5100\n",
            "\n",
            "2021/05/21 21:59:54\tINFO\ttorchdistill.misc.log\tEpoch: [84]  [  0/391]  eta: 0:04:52  lr: 0.1  img/s: 1083.2658977732222  loss: 0.0942 (0.0942)  time: 0.7483  data: 0.6301  max mem: 281\n",
            "2021/05/21 21:59:58\tINFO\ttorchdistill.misc.log\tEpoch: [84]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 3389.9572017604232  loss: 0.1970 (0.1934)  time: 0.0390  data: 0.0035  max mem: 281\n",
            "2021/05/21 22:00:02\tINFO\ttorchdistill.misc.log\tEpoch: [84]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 3380.6288851947006  loss: 0.2352 (0.2077)  time: 0.0389  data: 0.0035  max mem: 281\n",
            "2021/05/21 22:00:06\tINFO\ttorchdistill.misc.log\tEpoch: [84]  [300/391]  eta: 0:00:03  lr: 0.1  img/s: 4223.605261501668  loss: 0.2032 (0.2138)  time: 0.0380  data: 0.0039  max mem: 281\n",
            "2021/05/21 22:00:09\tINFO\ttorchdistill.misc.log\tEpoch: [84] Total time: 0:00:16\n",
            "2021/05/21 22:00:10\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 87.5000 (87.5000)  acc5: 100.0000 (100.0000)  time: 0.5587  data: 0.5357  max mem: 281\n",
            "2021/05/21 22:00:12\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:00:12\tINFO\t__main__\t * Acc@1 87.4800\tAcc@5 99.5000\n",
            "\n",
            "2021/05/21 22:00:13\tINFO\ttorchdistill.misc.log\tEpoch: [85]  [  0/391]  eta: 0:04:29  lr: 0.1  img/s: 1263.439716846148  loss: 0.1977 (0.1977)  time: 0.6898  data: 0.5885  max mem: 281\n",
            "2021/05/21 22:00:17\tINFO\ttorchdistill.misc.log\tEpoch: [85]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 3724.338975525834  loss: 0.2128 (0.2118)  time: 0.0411  data: 0.0058  max mem: 281\n",
            "2021/05/21 22:00:21\tINFO\ttorchdistill.misc.log\tEpoch: [85]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 4000.498595390496  loss: 0.1823 (0.2122)  time: 0.0378  data: 0.0046  max mem: 281\n",
            "2021/05/21 22:00:25\tINFO\ttorchdistill.misc.log\tEpoch: [85]  [300/391]  eta: 0:00:03  lr: 0.1  img/s: 3096.9450664820743  loss: 0.2132 (0.2183)  time: 0.0394  data: 0.0027  max mem: 281\n",
            "2021/05/21 22:00:28\tINFO\ttorchdistill.misc.log\tEpoch: [85] Total time: 0:00:16\n",
            "2021/05/21 22:00:29\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:43  acc1: 89.8438 (89.8438)  acc5: 98.4375 (98.4375)  time: 0.5547  data: 0.5216  max mem: 281\n",
            "2021/05/21 22:00:31\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:00:31\tINFO\t__main__\t * Acc@1 86.4100\tAcc@5 99.3800\n",
            "\n",
            "2021/05/21 22:00:32\tINFO\ttorchdistill.misc.log\tEpoch: [86]  [  0/391]  eta: 0:06:26  lr: 0.1  img/s: 1132.541092437152  loss: 0.2460 (0.2460)  time: 0.9888  data: 0.8758  max mem: 281\n",
            "2021/05/21 22:00:36\tINFO\ttorchdistill.misc.log\tEpoch: [86]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 3932.4000146493318  loss: 0.2181 (0.2036)  time: 0.0395  data: 0.0050  max mem: 281\n",
            "2021/05/21 22:00:40\tINFO\ttorchdistill.misc.log\tEpoch: [86]  [200/391]  eta: 0:00:09  lr: 0.1  img/s: 3255.637561019981  loss: 0.1899 (0.2132)  time: 0.0404  data: 0.0033  max mem: 281\n",
            "2021/05/21 22:00:44\tINFO\ttorchdistill.misc.log\tEpoch: [86]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 3032.980504036472  loss: 0.2389 (0.2155)  time: 0.0389  data: 0.0037  max mem: 281\n",
            "2021/05/21 22:00:48\tINFO\ttorchdistill.misc.log\tEpoch: [86] Total time: 0:00:16\n",
            "2021/05/21 22:00:48\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 85.9375 (85.9375)  acc5: 100.0000 (100.0000)  time: 0.5602  data: 0.5183  max mem: 281\n",
            "2021/05/21 22:00:50\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:00:50\tINFO\t__main__\t * Acc@1 86.5100\tAcc@5 99.6000\n",
            "\n",
            "2021/05/21 22:00:51\tINFO\ttorchdistill.misc.log\tEpoch: [87]  [  0/391]  eta: 0:04:44  lr: 0.1  img/s: 1035.3550019477839  loss: 0.2754 (0.2754)  time: 0.7283  data: 0.6046  max mem: 281\n",
            "2021/05/21 22:00:56\tINFO\ttorchdistill.misc.log\tEpoch: [87]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 3302.743794331695  loss: 0.2002 (0.2029)  time: 0.0394  data: 0.0041  max mem: 281\n",
            "2021/05/21 22:01:00\tINFO\ttorchdistill.misc.log\tEpoch: [87]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 4321.970970624461  loss: 0.2115 (0.2089)  time: 0.0415  data: 0.0050  max mem: 281\n",
            "2021/05/21 22:01:03\tINFO\ttorchdistill.misc.log\tEpoch: [87]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 4073.9629536883162  loss: 0.2114 (0.2125)  time: 0.0394  data: 0.0046  max mem: 281\n",
            "2021/05/21 22:01:07\tINFO\ttorchdistill.misc.log\tEpoch: [87] Total time: 0:00:16\n",
            "2021/05/21 22:01:08\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:59  acc1: 92.1875 (92.1875)  acc5: 98.4375 (98.4375)  time: 0.7545  data: 0.7370  max mem: 281\n",
            "2021/05/21 22:01:09\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:01:09\tINFO\t__main__\t * Acc@1 87.5300\tAcc@5 99.4900\n",
            "\n",
            "2021/05/21 22:01:10\tINFO\ttorchdistill.misc.log\tEpoch: [88]  [  0/391]  eta: 0:05:42  lr: 0.1  img/s: 1182.2824462614815  loss: 0.2846 (0.2846)  time: 0.8757  data: 0.7674  max mem: 281\n",
            "2021/05/21 22:01:14\tINFO\ttorchdistill.misc.log\tEpoch: [88]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 5350.197436868435  loss: 0.1806 (0.2129)  time: 0.0393  data: 0.0048  max mem: 281\n",
            "2021/05/21 22:01:18\tINFO\ttorchdistill.misc.log\tEpoch: [88]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 2918.506322232732  loss: 0.1888 (0.2125)  time: 0.0403  data: 0.0036  max mem: 281\n",
            "2021/05/21 22:01:22\tINFO\ttorchdistill.misc.log\tEpoch: [88]  [300/391]  eta: 0:00:04  lr: 0.1  img/s: 3358.6339022070965  loss: 0.1915 (0.2159)  time: 0.0415  data: 0.0047  max mem: 281\n",
            "2021/05/21 22:01:26\tINFO\ttorchdistill.misc.log\tEpoch: [88] Total time: 0:00:16\n",
            "2021/05/21 22:01:26\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:42  acc1: 90.6250 (90.6250)  acc5: 100.0000 (100.0000)  time: 0.5330  data: 0.5154  max mem: 281\n",
            "2021/05/21 22:01:28\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:01:28\tINFO\t__main__\t * Acc@1 88.4100\tAcc@5 99.5900\n",
            "\n",
            "2021/05/21 22:01:28\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 88.2000 -> 88.4100)\n",
            "2021/05/21 22:01:29\tINFO\ttorchdistill.misc.log\tEpoch: [89]  [  0/391]  eta: 0:05:06  lr: 0.1  img/s: 1222.3252349045242  loss: 0.2244 (0.2244)  time: 0.7851  data: 0.6804  max mem: 281\n",
            "2021/05/21 22:01:34\tINFO\ttorchdistill.misc.log\tEpoch: [89]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 3906.0497358962793  loss: 0.2341 (0.2023)  time: 0.0395  data: 0.0040  max mem: 281\n",
            "2021/05/21 22:01:38\tINFO\ttorchdistill.misc.log\tEpoch: [89]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 5227.615770358037  loss: 0.2152 (0.2110)  time: 0.0399  data: 0.0046  max mem: 281\n",
            "2021/05/21 22:01:42\tINFO\ttorchdistill.misc.log\tEpoch: [89]  [300/391]  eta: 0:00:03  lr: 0.1  img/s: 3094.909822504309  loss: 0.2112 (0.2157)  time: 0.0400  data: 0.0062  max mem: 281\n",
            "2021/05/21 22:01:45\tINFO\ttorchdistill.misc.log\tEpoch: [89] Total time: 0:00:16\n",
            "2021/05/21 22:01:45\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:45  acc1: 86.7188 (86.7188)  acc5: 99.2188 (99.2188)  time: 0.5784  data: 0.5399  max mem: 281\n",
            "2021/05/21 22:01:47\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:01:47\tINFO\t__main__\t * Acc@1 87.0300\tAcc@5 99.4500\n",
            "\n",
            "2021/05/21 22:01:48\tINFO\ttorchdistill.misc.log\tEpoch: [90]  [  0/391]  eta: 0:05:36  lr: 0.1  img/s: 1179.5264765202414  loss: 0.2165 (0.2165)  time: 0.8605  data: 0.7520  max mem: 281\n",
            "2021/05/21 22:01:53\tINFO\ttorchdistill.misc.log\tEpoch: [90]  [100/391]  eta: 0:00:15  lr: 0.1  img/s: 3768.784657288069  loss: 0.2093 (0.2041)  time: 0.0402  data: 0.0042  max mem: 281\n",
            "2021/05/21 22:01:57\tINFO\ttorchdistill.misc.log\tEpoch: [90]  [200/391]  eta: 0:00:08  lr: 0.1  img/s: 4608.017578192055  loss: 0.2303 (0.2095)  time: 0.0399  data: 0.0055  max mem: 281\n",
            "2021/05/21 22:02:00\tINFO\ttorchdistill.misc.log\tEpoch: [90]  [300/391]  eta: 0:00:03  lr: 0.1  img/s: 3306.608722430603  loss: 0.2370 (0.2155)  time: 0.0387  data: 0.0025  max mem: 281\n",
            "2021/05/21 22:02:04\tINFO\ttorchdistill.misc.log\tEpoch: [90] Total time: 0:00:16\n",
            "2021/05/21 22:02:04\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:47  acc1: 92.9688 (92.9688)  acc5: 99.2188 (99.2188)  time: 0.5967  data: 0.5539  max mem: 281\n",
            "2021/05/21 22:02:06\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:02:06\tINFO\t__main__\t * Acc@1 86.6500\tAcc@5 99.4600\n",
            "\n",
            "2021/05/21 22:02:07\tINFO\ttorchdistill.misc.log\tEpoch: [91]  [  0/391]  eta: 0:05:30  lr: 0.010000000000000002  img/s: 1157.7405304459774  loss: 0.2835 (0.2835)  time: 0.8465  data: 0.7359  max mem: 281\n",
            "2021/05/21 22:02:12\tINFO\ttorchdistill.misc.log\tEpoch: [91]  [100/391]  eta: 0:00:15  lr: 0.010000000000000002  img/s: 4116.666247488766  loss: 0.1384 (0.1578)  time: 0.0404  data: 0.0039  max mem: 281\n",
            "2021/05/21 22:02:16\tINFO\ttorchdistill.misc.log\tEpoch: [91]  [200/391]  eta: 0:00:08  lr: 0.010000000000000002  img/s: 2701.6586838701887  loss: 0.1254 (0.1426)  time: 0.0395  data: 0.0044  max mem: 281\n",
            "2021/05/21 22:02:20\tINFO\ttorchdistill.misc.log\tEpoch: [91]  [300/391]  eta: 0:00:04  lr: 0.010000000000000002  img/s: 3645.9824244482174  loss: 0.1087 (0.1347)  time: 0.0390  data: 0.0042  max mem: 281\n",
            "2021/05/21 22:02:23\tINFO\ttorchdistill.misc.log\tEpoch: [91] Total time: 0:00:16\n",
            "2021/05/21 22:02:24\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:45  acc1: 94.5312 (94.5312)  acc5: 100.0000 (100.0000)  time: 0.5767  data: 0.5662  max mem: 281\n",
            "2021/05/21 22:02:25\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:02:25\tINFO\t__main__\t * Acc@1 91.3600\tAcc@5 99.6900\n",
            "\n",
            "2021/05/21 22:02:25\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 88.4100 -> 91.3600)\n",
            "2021/05/21 22:02:26\tINFO\ttorchdistill.misc.log\tEpoch: [92]  [  0/391]  eta: 0:06:32  lr: 0.010000000000000002  img/s: 1054.0417830743406  loss: 0.1244 (0.1244)  time: 1.0043  data: 0.8829  max mem: 281\n",
            "2021/05/21 22:02:31\tINFO\ttorchdistill.misc.log\tEpoch: [92]  [100/391]  eta: 0:00:15  lr: 0.010000000000000002  img/s: 3792.961284123665  loss: 0.0962 (0.1133)  time: 0.0400  data: 0.0047  max mem: 281\n",
            "2021/05/21 22:02:35\tINFO\ttorchdistill.misc.log\tEpoch: [92]  [200/391]  eta: 0:00:08  lr: 0.010000000000000002  img/s: 3733.0402180564056  loss: 0.0953 (0.1095)  time: 0.0410  data: 0.0050  max mem: 281\n",
            "2021/05/21 22:02:39\tINFO\ttorchdistill.misc.log\tEpoch: [92]  [300/391]  eta: 0:00:04  lr: 0.010000000000000002  img/s: 4252.409184877743  loss: 0.1026 (0.1089)  time: 0.0388  data: 0.0048  max mem: 281\n",
            "2021/05/21 22:02:42\tINFO\ttorchdistill.misc.log\tEpoch: [92] Total time: 0:00:16\n",
            "2021/05/21 22:02:43\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:01:12  acc1: 92.1875 (92.1875)  acc5: 100.0000 (100.0000)  time: 0.9198  data: 0.8944  max mem: 281\n",
            "2021/05/21 22:02:45\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:02:45\tINFO\t__main__\t * Acc@1 91.5500\tAcc@5 99.7200\n",
            "\n",
            "2021/05/21 22:02:45\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 91.3600 -> 91.5500)\n",
            "2021/05/21 22:02:45\tINFO\ttorchdistill.misc.log\tEpoch: [93]  [  0/391]  eta: 0:04:15  lr: 0.010000000000000002  img/s: 1226.2394094363196  loss: 0.0753 (0.0753)  time: 0.6531  data: 0.5487  max mem: 281\n",
            "2021/05/21 22:02:50\tINFO\ttorchdistill.misc.log\tEpoch: [93]  [100/391]  eta: 0:00:15  lr: 0.010000000000000002  img/s: 4878.116903059324  loss: 0.1014 (0.0970)  time: 0.0390  data: 0.0044  max mem: 281\n",
            "2021/05/21 22:02:54\tINFO\ttorchdistill.misc.log\tEpoch: [93]  [200/391]  eta: 0:00:08  lr: 0.010000000000000002  img/s: 2833.3460627074724  loss: 0.0940 (0.0991)  time: 0.0383  data: 0.0041  max mem: 281\n",
            "2021/05/21 22:02:58\tINFO\ttorchdistill.misc.log\tEpoch: [93]  [300/391]  eta: 0:00:04  lr: 0.010000000000000002  img/s: 3915.9931435407048  loss: 0.0960 (0.0970)  time: 0.0392  data: 0.0039  max mem: 281\n",
            "2021/05/21 22:03:01\tINFO\ttorchdistill.misc.log\tEpoch: [93] Total time: 0:00:16\n",
            "2021/05/21 22:03:02\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:46  acc1: 92.9688 (92.9688)  acc5: 100.0000 (100.0000)  time: 0.5917  data: 0.5527  max mem: 281\n",
            "2021/05/21 22:03:04\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:03:04\tINFO\t__main__\t * Acc@1 91.5600\tAcc@5 99.7300\n",
            "\n",
            "2021/05/21 22:03:04\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 91.5500 -> 91.5600)\n",
            "2021/05/21 22:03:05\tINFO\ttorchdistill.misc.log\tEpoch: [94]  [  0/391]  eta: 0:05:05  lr: 0.010000000000000002  img/s: 1120.1566342988053  loss: 0.1646 (0.1646)  time: 0.7826  data: 0.6683  max mem: 281\n",
            "2021/05/21 22:03:09\tINFO\ttorchdistill.misc.log\tEpoch: [94]  [100/391]  eta: 0:00:15  lr: 0.010000000000000002  img/s: 3942.912522675362  loss: 0.0821 (0.0877)  time: 0.0404  data: 0.0047  max mem: 281\n",
            "2021/05/21 22:03:13\tINFO\ttorchdistill.misc.log\tEpoch: [94]  [200/391]  eta: 0:00:08  lr: 0.010000000000000002  img/s: 2611.4049623760257  loss: 0.0780 (0.0852)  time: 0.0397  data: 0.0040  max mem: 281\n",
            "2021/05/21 22:03:17\tINFO\ttorchdistill.misc.log\tEpoch: [94]  [300/391]  eta: 0:00:03  lr: 0.010000000000000002  img/s: 3244.9721784015424  loss: 0.1030 (0.0874)  time: 0.0403  data: 0.0042  max mem: 281\n",
            "2021/05/21 22:03:20\tINFO\ttorchdistill.misc.log\tEpoch: [94] Total time: 0:00:16\n",
            "2021/05/21 22:03:21\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 92.1875 (92.1875)  acc5: 100.0000 (100.0000)  time: 0.5667  data: 0.5353  max mem: 281\n",
            "2021/05/21 22:03:23\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:03:23\tINFO\t__main__\t * Acc@1 91.5100\tAcc@5 99.7700\n",
            "\n",
            "2021/05/21 22:03:24\tINFO\ttorchdistill.misc.log\tEpoch: [95]  [  0/391]  eta: 0:05:39  lr: 0.010000000000000002  img/s: 1138.1183503703485  loss: 0.0777 (0.0777)  time: 0.8684  data: 0.7559  max mem: 281\n",
            "2021/05/21 22:03:28\tINFO\ttorchdistill.misc.log\tEpoch: [95]  [100/391]  eta: 0:00:15  lr: 0.010000000000000002  img/s: 4249.447217407135  loss: 0.0695 (0.0764)  time: 0.0396  data: 0.0054  max mem: 281\n",
            "2021/05/21 22:03:32\tINFO\ttorchdistill.misc.log\tEpoch: [95]  [200/391]  eta: 0:00:08  lr: 0.010000000000000002  img/s: 3527.6127497683833  loss: 0.0791 (0.0822)  time: 0.0385  data: 0.0045  max mem: 281\n",
            "2021/05/21 22:03:36\tINFO\ttorchdistill.misc.log\tEpoch: [95]  [300/391]  eta: 0:00:03  lr: 0.010000000000000002  img/s: 3168.7073169292153  loss: 0.0659 (0.0821)  time: 0.0384  data: 0.0033  max mem: 281\n",
            "2021/05/21 22:03:39\tINFO\ttorchdistill.misc.log\tEpoch: [95] Total time: 0:00:16\n",
            "2021/05/21 22:03:40\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:52  acc1: 92.9688 (92.9688)  acc5: 100.0000 (100.0000)  time: 0.6665  data: 0.6440  max mem: 281\n",
            "2021/05/21 22:03:42\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:03:42\tINFO\t__main__\t * Acc@1 91.7900\tAcc@5 99.7800\n",
            "\n",
            "2021/05/21 22:03:42\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 91.5600 -> 91.7900)\n",
            "2021/05/21 22:03:43\tINFO\ttorchdistill.misc.log\tEpoch: [96]  [  0/391]  eta: 0:04:37  lr: 0.010000000000000002  img/s: 1113.7037416581788  loss: 0.0562 (0.0562)  time: 0.7099  data: 0.5949  max mem: 281\n",
            "2021/05/21 22:03:47\tINFO\ttorchdistill.misc.log\tEpoch: [96]  [100/391]  eta: 0:00:15  lr: 0.010000000000000002  img/s: 3601.855112912099  loss: 0.0800 (0.0751)  time: 0.0388  data: 0.0031  max mem: 281\n",
            "2021/05/21 22:03:51\tINFO\ttorchdistill.misc.log\tEpoch: [96]  [200/391]  eta: 0:00:08  lr: 0.010000000000000002  img/s: 3470.6245523304674  loss: 0.0643 (0.0762)  time: 0.0397  data: 0.0044  max mem: 281\n",
            "2021/05/21 22:03:55\tINFO\ttorchdistill.misc.log\tEpoch: [96]  [300/391]  eta: 0:00:03  lr: 0.010000000000000002  img/s: 3340.8686604687055  loss: 0.0738 (0.0779)  time: 0.0409  data: 0.0042  max mem: 281\n",
            "2021/05/21 22:03:58\tINFO\ttorchdistill.misc.log\tEpoch: [96] Total time: 0:00:16\n",
            "2021/05/21 22:03:59\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:45  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5729  data: 0.5425  max mem: 281\n",
            "2021/05/21 22:04:01\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:04:01\tINFO\t__main__\t * Acc@1 91.7400\tAcc@5 99.7500\n",
            "\n",
            "2021/05/21 22:04:02\tINFO\ttorchdistill.misc.log\tEpoch: [97]  [  0/391]  eta: 0:04:17  lr: 0.010000000000000002  img/s: 1138.6542240019003  loss: 0.0640 (0.0640)  time: 0.6597  data: 0.5473  max mem: 281\n",
            "2021/05/21 22:04:06\tINFO\ttorchdistill.misc.log\tEpoch: [97]  [100/391]  eta: 0:00:15  lr: 0.010000000000000002  img/s: 2932.919486479104  loss: 0.0742 (0.0741)  time: 0.0397  data: 0.0041  max mem: 281\n",
            "2021/05/21 22:04:10\tINFO\ttorchdistill.misc.log\tEpoch: [97]  [200/391]  eta: 0:00:08  lr: 0.010000000000000002  img/s: 4341.438048875159  loss: 0.0755 (0.0731)  time: 0.0399  data: 0.0041  max mem: 281\n",
            "2021/05/21 22:04:14\tINFO\ttorchdistill.misc.log\tEpoch: [97]  [300/391]  eta: 0:00:03  lr: 0.010000000000000002  img/s: 4275.981936203258  loss: 0.0676 (0.0754)  time: 0.0367  data: 0.0050  max mem: 281\n",
            "2021/05/21 22:04:18\tINFO\ttorchdistill.misc.log\tEpoch: [97] Total time: 0:00:16\n",
            "2021/05/21 22:04:18\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:49  acc1: 92.9688 (92.9688)  acc5: 100.0000 (100.0000)  time: 0.6291  data: 0.5548  max mem: 281\n",
            "2021/05/21 22:04:20\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:04:20\tINFO\t__main__\t * Acc@1 91.8500\tAcc@5 99.7700\n",
            "\n",
            "2021/05/21 22:04:20\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 91.7900 -> 91.8500)\n",
            "2021/05/21 22:04:21\tINFO\ttorchdistill.misc.log\tEpoch: [98]  [  0/391]  eta: 0:05:41  lr: 0.010000000000000002  img/s: 1067.7899627476447  loss: 0.0908 (0.0908)  time: 0.8730  data: 0.7531  max mem: 281\n",
            "2021/05/21 22:04:25\tINFO\ttorchdistill.misc.log\tEpoch: [98]  [100/391]  eta: 0:00:15  lr: 0.010000000000000002  img/s: 3551.2737519596235  loss: 0.0670 (0.0727)  time: 0.0382  data: 0.0029  max mem: 281\n",
            "2021/05/21 22:04:29\tINFO\ttorchdistill.misc.log\tEpoch: [98]  [200/391]  eta: 0:00:08  lr: 0.010000000000000002  img/s: 4003.5713582603767  loss: 0.0724 (0.0736)  time: 0.0395  data: 0.0054  max mem: 281\n",
            "2021/05/21 22:04:33\tINFO\ttorchdistill.misc.log\tEpoch: [98]  [300/391]  eta: 0:00:03  lr: 0.010000000000000002  img/s: 3998.4427794741937  loss: 0.0718 (0.0731)  time: 0.0406  data: 0.0056  max mem: 281\n",
            "2021/05/21 22:04:37\tINFO\ttorchdistill.misc.log\tEpoch: [98] Total time: 0:00:16\n",
            "2021/05/21 22:04:37\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:48  acc1: 92.9688 (92.9688)  acc5: 100.0000 (100.0000)  time: 0.6150  data: 0.5903  max mem: 281\n",
            "2021/05/21 22:04:39\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:04:39\tINFO\t__main__\t * Acc@1 91.7300\tAcc@5 99.8000\n",
            "\n",
            "2021/05/21 22:04:40\tINFO\ttorchdistill.misc.log\tEpoch: [99]  [  0/391]  eta: 0:04:14  lr: 0.010000000000000002  img/s: 1020.9291586243618  loss: 0.0635 (0.0635)  time: 0.6520  data: 0.5266  max mem: 281\n",
            "2021/05/21 22:04:44\tINFO\ttorchdistill.misc.log\tEpoch: [99]  [100/391]  eta: 0:00:15  lr: 0.010000000000000002  img/s: 3151.2241781075195  loss: 0.0618 (0.0649)  time: 0.0394  data: 0.0047  max mem: 281\n",
            "2021/05/21 22:04:48\tINFO\ttorchdistill.misc.log\tEpoch: [99]  [200/391]  eta: 0:00:08  lr: 0.010000000000000002  img/s: 5219.484070426506  loss: 0.0687 (0.0685)  time: 0.0382  data: 0.0030  max mem: 281\n",
            "2021/05/21 22:04:52\tINFO\ttorchdistill.misc.log\tEpoch: [99]  [300/391]  eta: 0:00:03  lr: 0.010000000000000002  img/s: 4293.662022745086  loss: 0.0618 (0.0680)  time: 0.0382  data: 0.0033  max mem: 281\n",
            "2021/05/21 22:04:56\tINFO\ttorchdistill.misc.log\tEpoch: [99] Total time: 0:00:16\n",
            "2021/05/21 22:04:56\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:48  acc1: 92.1875 (92.1875)  acc5: 100.0000 (100.0000)  time: 0.6165  data: 0.5690  max mem: 281\n",
            "2021/05/21 22:04:58\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:04:58\tINFO\t__main__\t * Acc@1 91.8100\tAcc@5 99.7900\n",
            "\n",
            "2021/05/21 22:04:59\tINFO\ttorchdistill.misc.log\tEpoch: [100]  [  0/391]  eta: 0:05:28  lr: 0.010000000000000002  img/s: 1176.7162642878277  loss: 0.0578 (0.0578)  time: 0.8393  data: 0.7305  max mem: 281\n",
            "2021/05/21 22:05:03\tINFO\ttorchdistill.misc.log\tEpoch: [100]  [100/391]  eta: 0:00:15  lr: 0.010000000000000002  img/s: 3452.1242549141907  loss: 0.0533 (0.0627)  time: 0.0399  data: 0.0046  max mem: 281\n",
            "2021/05/21 22:05:07\tINFO\ttorchdistill.misc.log\tEpoch: [100]  [200/391]  eta: 0:00:08  lr: 0.010000000000000002  img/s: 3901.6497845219146  loss: 0.0501 (0.0624)  time: 0.0393  data: 0.0063  max mem: 281\n",
            "2021/05/21 22:05:11\tINFO\ttorchdistill.misc.log\tEpoch: [100]  [300/391]  eta: 0:00:04  lr: 0.010000000000000002  img/s: 3372.5589366032614  loss: 0.0667 (0.0638)  time: 0.0393  data: 0.0055  max mem: 281\n",
            "2021/05/21 22:05:15\tINFO\ttorchdistill.misc.log\tEpoch: [100] Total time: 0:00:16\n",
            "2021/05/21 22:05:15\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:47  acc1: 92.1875 (92.1875)  acc5: 100.0000 (100.0000)  time: 0.6014  data: 0.5727  max mem: 281\n",
            "2021/05/21 22:05:17\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:05:17\tINFO\t__main__\t * Acc@1 91.4600\tAcc@5 99.8000\n",
            "\n",
            "2021/05/21 22:05:18\tINFO\ttorchdistill.misc.log\tEpoch: [101]  [  0/391]  eta: 0:05:38  lr: 0.010000000000000002  img/s: 1069.7367296840628  loss: 0.0709 (0.0709)  time: 0.8660  data: 0.7463  max mem: 281\n",
            "2021/05/21 22:05:23\tINFO\ttorchdistill.misc.log\tEpoch: [101]  [100/391]  eta: 0:00:15  lr: 0.010000000000000002  img/s: 3763.1842090506366  loss: 0.0626 (0.0653)  time: 0.0401  data: 0.0044  max mem: 281\n",
            "2021/05/21 22:05:27\tINFO\ttorchdistill.misc.log\tEpoch: [101]  [200/391]  eta: 0:00:08  lr: 0.010000000000000002  img/s: 3441.8332136629397  loss: 0.0494 (0.0638)  time: 0.0414  data: 0.0043  max mem: 281\n",
            "2021/05/21 22:05:31\tINFO\ttorchdistill.misc.log\tEpoch: [101]  [300/391]  eta: 0:00:04  lr: 0.010000000000000002  img/s: 3521.342445986541  loss: 0.0626 (0.0641)  time: 0.0389  data: 0.0034  max mem: 281\n",
            "2021/05/21 22:05:34\tINFO\ttorchdistill.misc.log\tEpoch: [101] Total time: 0:00:16\n",
            "2021/05/21 22:05:35\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:47  acc1: 92.1875 (92.1875)  acc5: 100.0000 (100.0000)  time: 0.5995  data: 0.5606  max mem: 281\n",
            "2021/05/21 22:05:37\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:05:37\tINFO\t__main__\t * Acc@1 91.6900\tAcc@5 99.7300\n",
            "\n",
            "2021/05/21 22:05:37\tINFO\ttorchdistill.misc.log\tEpoch: [102]  [  0/391]  eta: 0:04:27  lr: 0.010000000000000002  img/s: 982.9560071771211  loss: 0.0695 (0.0695)  time: 0.6829  data: 0.5527  max mem: 281\n",
            "2021/05/21 22:05:42\tINFO\ttorchdistill.misc.log\tEpoch: [102]  [100/391]  eta: 0:00:15  lr: 0.010000000000000002  img/s: 2718.4438458266663  loss: 0.0515 (0.0587)  time: 0.0392  data: 0.0035  max mem: 281\n",
            "2021/05/21 22:05:46\tINFO\ttorchdistill.misc.log\tEpoch: [102]  [200/391]  eta: 0:00:08  lr: 0.010000000000000002  img/s: 4060.497904975117  loss: 0.0624 (0.0604)  time: 0.0412  data: 0.0072  max mem: 281\n",
            "2021/05/21 22:05:50\tINFO\ttorchdistill.misc.log\tEpoch: [102]  [300/391]  eta: 0:00:04  lr: 0.010000000000000002  img/s: 3837.9448261071593  loss: 0.0514 (0.0602)  time: 0.0396  data: 0.0041  max mem: 281\n",
            "2021/05/21 22:05:53\tINFO\ttorchdistill.misc.log\tEpoch: [102] Total time: 0:00:16\n",
            "2021/05/21 22:05:54\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:43  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5475  data: 0.5055  max mem: 281\n",
            "2021/05/21 22:05:56\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:05:56\tINFO\t__main__\t * Acc@1 91.7500\tAcc@5 99.7700\n",
            "\n",
            "2021/05/21 22:05:57\tINFO\ttorchdistill.misc.log\tEpoch: [103]  [  0/391]  eta: 0:05:23  lr: 0.010000000000000002  img/s: 1133.0167270946856  loss: 0.0826 (0.0826)  time: 0.8274  data: 0.7144  max mem: 281\n",
            "2021/05/21 22:06:01\tINFO\ttorchdistill.misc.log\tEpoch: [103]  [100/391]  eta: 0:00:15  lr: 0.010000000000000002  img/s: 4203.597892214819  loss: 0.0599 (0.0590)  time: 0.0377  data: 0.0040  max mem: 281\n",
            "2021/05/21 22:06:05\tINFO\ttorchdistill.misc.log\tEpoch: [103]  [200/391]  eta: 0:00:08  lr: 0.010000000000000002  img/s: 5359.2232947682605  loss: 0.0550 (0.0607)  time: 0.0372  data: 0.0035  max mem: 281\n",
            "2021/05/21 22:06:09\tINFO\ttorchdistill.misc.log\tEpoch: [103]  [300/391]  eta: 0:00:03  lr: 0.010000000000000002  img/s: 4201.558252921059  loss: 0.0609 (0.0612)  time: 0.0397  data: 0.0039  max mem: 281\n",
            "2021/05/21 22:06:12\tINFO\ttorchdistill.misc.log\tEpoch: [103] Total time: 0:00:16\n",
            "2021/05/21 22:06:13\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:42  acc1: 92.1875 (92.1875)  acc5: 100.0000 (100.0000)  time: 0.5326  data: 0.5000  max mem: 281\n",
            "2021/05/21 22:06:15\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:06:15\tINFO\t__main__\t * Acc@1 91.7000\tAcc@5 99.8200\n",
            "\n",
            "2021/05/21 22:06:15\tINFO\ttorchdistill.misc.log\tEpoch: [104]  [  0/391]  eta: 0:04:50  lr: 0.010000000000000002  img/s: 997.9681019547777  loss: 0.0254 (0.0254)  time: 0.7436  data: 0.6153  max mem: 281\n",
            "2021/05/21 22:06:20\tINFO\ttorchdistill.misc.log\tEpoch: [104]  [100/391]  eta: 0:00:15  lr: 0.010000000000000002  img/s: 3869.8419398552605  loss: 0.0457 (0.0577)  time: 0.0398  data: 0.0046  max mem: 281\n",
            "2021/05/21 22:06:24\tINFO\ttorchdistill.misc.log\tEpoch: [104]  [200/391]  eta: 0:00:08  lr: 0.010000000000000002  img/s: 5089.788699279484  loss: 0.0567 (0.0570)  time: 0.0394  data: 0.0035  max mem: 281\n",
            "2021/05/21 22:06:28\tINFO\ttorchdistill.misc.log\tEpoch: [104]  [300/391]  eta: 0:00:04  lr: 0.010000000000000002  img/s: 4100.003910068426  loss: 0.0509 (0.0566)  time: 0.0395  data: 0.0040  max mem: 281\n",
            "2021/05/21 22:06:31\tINFO\ttorchdistill.misc.log\tEpoch: [104] Total time: 0:00:16\n",
            "2021/05/21 22:06:32\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:46  acc1: 92.9688 (92.9688)  acc5: 100.0000 (100.0000)  time: 0.5930  data: 0.5426  max mem: 281\n",
            "2021/05/21 22:06:34\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:06:34\tINFO\t__main__\t * Acc@1 91.6500\tAcc@5 99.7700\n",
            "\n",
            "2021/05/21 22:06:35\tINFO\ttorchdistill.misc.log\tEpoch: [105]  [  0/391]  eta: 0:06:19  lr: 0.010000000000000002  img/s: 1164.6219318282888  loss: 0.0269 (0.0269)  time: 0.9710  data: 0.8610  max mem: 281\n",
            "2021/05/21 22:06:39\tINFO\ttorchdistill.misc.log\tEpoch: [105]  [100/391]  eta: 0:00:15  lr: 0.010000000000000002  img/s: 4408.313862020265  loss: 0.0456 (0.0577)  time: 0.0408  data: 0.0042  max mem: 281\n",
            "2021/05/21 22:06:43\tINFO\ttorchdistill.misc.log\tEpoch: [105]  [200/391]  eta: 0:00:08  lr: 0.010000000000000002  img/s: 5315.816743403138  loss: 0.0426 (0.0560)  time: 0.0414  data: 0.0057  max mem: 281\n",
            "2021/05/21 22:06:47\tINFO\ttorchdistill.misc.log\tEpoch: [105]  [300/391]  eta: 0:00:04  lr: 0.010000000000000002  img/s: 5455.450787521593  loss: 0.0553 (0.0550)  time: 0.0402  data: 0.0041  max mem: 281\n",
            "2021/05/21 22:06:50\tINFO\ttorchdistill.misc.log\tEpoch: [105] Total time: 0:00:16\n",
            "2021/05/21 22:06:51\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:48  acc1: 95.3125 (95.3125)  acc5: 100.0000 (100.0000)  time: 0.6141  data: 0.5352  max mem: 281\n",
            "2021/05/21 22:06:53\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:06:53\tINFO\t__main__\t * Acc@1 91.8400\tAcc@5 99.8200\n",
            "\n",
            "2021/05/21 22:06:54\tINFO\ttorchdistill.misc.log\tEpoch: [106]  [  0/391]  eta: 0:05:36  lr: 0.010000000000000002  img/s: 1117.2474392857887  loss: 0.0170 (0.0170)  time: 0.8602  data: 0.7455  max mem: 281\n",
            "2021/05/21 22:06:58\tINFO\ttorchdistill.misc.log\tEpoch: [106]  [100/391]  eta: 0:00:15  lr: 0.010000000000000002  img/s: 4833.887776417201  loss: 0.0462 (0.0540)  time: 0.0388  data: 0.0052  max mem: 281\n",
            "2021/05/21 22:07:02\tINFO\ttorchdistill.misc.log\tEpoch: [106]  [200/391]  eta: 0:00:08  lr: 0.010000000000000002  img/s: 2533.904009439528  loss: 0.0567 (0.0540)  time: 0.0375  data: 0.0051  max mem: 281\n",
            "2021/05/21 22:07:06\tINFO\ttorchdistill.misc.log\tEpoch: [106]  [300/391]  eta: 0:00:03  lr: 0.010000000000000002  img/s: 3878.0042762207454  loss: 0.0564 (0.0544)  time: 0.0393  data: 0.0044  max mem: 281\n",
            "2021/05/21 22:07:09\tINFO\ttorchdistill.misc.log\tEpoch: [106] Total time: 0:00:16\n",
            "2021/05/21 22:07:10\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:45  acc1: 92.9688 (92.9688)  acc5: 100.0000 (100.0000)  time: 0.5749  data: 0.5315  max mem: 281\n",
            "2021/05/21 22:07:12\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:07:12\tINFO\t__main__\t * Acc@1 91.6100\tAcc@5 99.8000\n",
            "\n",
            "2021/05/21 22:07:13\tINFO\ttorchdistill.misc.log\tEpoch: [107]  [  0/391]  eta: 0:04:47  lr: 0.010000000000000002  img/s: 1092.2688888934101  loss: 0.0397 (0.0397)  time: 0.7348  data: 0.6176  max mem: 281\n",
            "2021/05/21 22:07:17\tINFO\ttorchdistill.misc.log\tEpoch: [107]  [100/391]  eta: 0:00:15  lr: 0.010000000000000002  img/s: 4592.408403476356  loss: 0.0520 (0.0514)  time: 0.0398  data: 0.0056  max mem: 281\n",
            "2021/05/21 22:07:21\tINFO\ttorchdistill.misc.log\tEpoch: [107]  [200/391]  eta: 0:00:08  lr: 0.010000000000000002  img/s: 2666.648017166018  loss: 0.0565 (0.0515)  time: 0.0400  data: 0.0051  max mem: 281\n",
            "2021/05/21 22:07:25\tINFO\ttorchdistill.misc.log\tEpoch: [107]  [300/391]  eta: 0:00:03  lr: 0.010000000000000002  img/s: 4409.436261344504  loss: 0.0410 (0.0511)  time: 0.0403  data: 0.0055  max mem: 281\n",
            "2021/05/21 22:07:28\tINFO\ttorchdistill.misc.log\tEpoch: [107] Total time: 0:00:16\n",
            "2021/05/21 22:07:29\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:47  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.6064  data: 0.5568  max mem: 281\n",
            "2021/05/21 22:07:31\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:07:31\tINFO\t__main__\t * Acc@1 91.9300\tAcc@5 99.7800\n",
            "\n",
            "2021/05/21 22:07:31\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 91.8500 -> 91.9300)\n",
            "2021/05/21 22:07:32\tINFO\ttorchdistill.misc.log\tEpoch: [108]  [  0/391]  eta: 0:04:17  lr: 0.010000000000000002  img/s: 1060.288878706966  loss: 0.0814 (0.0814)  time: 0.6588  data: 0.5380  max mem: 281\n",
            "2021/05/21 22:07:36\tINFO\ttorchdistill.misc.log\tEpoch: [108]  [100/391]  eta: 0:00:15  lr: 0.010000000000000002  img/s: 2612.6122282132637  loss: 0.0371 (0.0479)  time: 0.0397  data: 0.0040  max mem: 281\n",
            "2021/05/21 22:07:40\tINFO\ttorchdistill.misc.log\tEpoch: [108]  [200/391]  eta: 0:00:08  lr: 0.010000000000000002  img/s: 3265.2806383729276  loss: 0.0458 (0.0503)  time: 0.0380  data: 0.0023  max mem: 281\n",
            "2021/05/21 22:07:44\tINFO\ttorchdistill.misc.log\tEpoch: [108]  [300/391]  eta: 0:00:03  lr: 0.010000000000000002  img/s: 4907.412358318099  loss: 0.0641 (0.0527)  time: 0.0372  data: 0.0042  max mem: 281\n",
            "2021/05/21 22:07:47\tINFO\ttorchdistill.misc.log\tEpoch: [108] Total time: 0:00:16\n",
            "2021/05/21 22:07:48\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:46  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5826  data: 0.5276  max mem: 281\n",
            "2021/05/21 22:07:50\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:07:50\tINFO\t__main__\t * Acc@1 91.5400\tAcc@5 99.8200\n",
            "\n",
            "2021/05/21 22:07:51\tINFO\ttorchdistill.misc.log\tEpoch: [109]  [  0/391]  eta: 0:05:19  lr: 0.010000000000000002  img/s: 1166.2588022661707  loss: 0.0586 (0.0586)  time: 0.8175  data: 0.7077  max mem: 281\n",
            "2021/05/21 22:07:55\tINFO\ttorchdistill.misc.log\tEpoch: [109]  [100/391]  eta: 0:00:15  lr: 0.010000000000000002  img/s: 3008.5397620608687  loss: 0.0477 (0.0511)  time: 0.0411  data: 0.0045  max mem: 281\n",
            "2021/05/21 22:07:59\tINFO\ttorchdistill.misc.log\tEpoch: [109]  [200/391]  eta: 0:00:08  lr: 0.010000000000000002  img/s: 3198.9352908930573  loss: 0.0417 (0.0513)  time: 0.0396  data: 0.0057  max mem: 281\n",
            "2021/05/21 22:08:03\tINFO\ttorchdistill.misc.log\tEpoch: [109]  [300/391]  eta: 0:00:04  lr: 0.010000000000000002  img/s: 2957.9501600542144  loss: 0.0501 (0.0520)  time: 0.0393  data: 0.0038  max mem: 281\n",
            "2021/05/21 22:08:07\tINFO\ttorchdistill.misc.log\tEpoch: [109] Total time: 0:00:16\n",
            "2021/05/21 22:08:07\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:46  acc1: 92.9688 (92.9688)  acc5: 100.0000 (100.0000)  time: 0.5918  data: 0.5465  max mem: 281\n",
            "2021/05/21 22:08:09\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:08:09\tINFO\t__main__\t * Acc@1 92.0400\tAcc@5 99.7900\n",
            "\n",
            "2021/05/21 22:08:09\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 91.9300 -> 92.0400)\n",
            "2021/05/21 22:08:10\tINFO\ttorchdistill.misc.log\tEpoch: [110]  [  0/391]  eta: 0:04:01  lr: 0.010000000000000002  img/s: 1237.8825780895133  loss: 0.0399 (0.0399)  time: 0.6177  data: 0.5142  max mem: 281\n",
            "2021/05/21 22:08:14\tINFO\ttorchdistill.misc.log\tEpoch: [110]  [100/391]  eta: 0:00:15  lr: 0.010000000000000002  img/s: 3471.7691656050542  loss: 0.0431 (0.0453)  time: 0.0400  data: 0.0049  max mem: 281\n",
            "2021/05/21 22:08:18\tINFO\ttorchdistill.misc.log\tEpoch: [110]  [200/391]  eta: 0:00:08  lr: 0.010000000000000002  img/s: 3764.7939524413932  loss: 0.0595 (0.0471)  time: 0.0409  data: 0.0042  max mem: 281\n",
            "2021/05/21 22:08:22\tINFO\ttorchdistill.misc.log\tEpoch: [110]  [300/391]  eta: 0:00:04  lr: 0.010000000000000002  img/s: 3960.2179897614446  loss: 0.0429 (0.0474)  time: 0.0387  data: 0.0052  max mem: 281\n",
            "2021/05/21 22:08:26\tINFO\ttorchdistill.misc.log\tEpoch: [110] Total time: 0:00:16\n",
            "2021/05/21 22:08:26\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:46  acc1: 92.9688 (92.9688)  acc5: 100.0000 (100.0000)  time: 0.5857  data: 0.5511  max mem: 281\n",
            "2021/05/21 22:08:28\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:08:28\tINFO\t__main__\t * Acc@1 91.7500\tAcc@5 99.7600\n",
            "\n",
            "2021/05/21 22:08:29\tINFO\ttorchdistill.misc.log\tEpoch: [111]  [  0/391]  eta: 0:05:08  lr: 0.010000000000000002  img/s: 1207.610250734975  loss: 0.0502 (0.0502)  time: 0.7902  data: 0.6842  max mem: 281\n",
            "2021/05/21 22:08:34\tINFO\ttorchdistill.misc.log\tEpoch: [111]  [100/391]  eta: 0:00:15  lr: 0.010000000000000002  img/s: 2657.3558248198306  loss: 0.0437 (0.0479)  time: 0.0373  data: 0.0043  max mem: 281\n",
            "2021/05/21 22:08:38\tINFO\ttorchdistill.misc.log\tEpoch: [111]  [200/391]  eta: 0:00:08  lr: 0.010000000000000002  img/s: 4503.383903032336  loss: 0.0432 (0.0486)  time: 0.0402  data: 0.0056  max mem: 281\n",
            "2021/05/21 22:08:41\tINFO\ttorchdistill.misc.log\tEpoch: [111]  [300/391]  eta: 0:00:04  lr: 0.010000000000000002  img/s: 4135.693469117353  loss: 0.0394 (0.0484)  time: 0.0396  data: 0.0051  max mem: 281\n",
            "2021/05/21 22:08:45\tINFO\ttorchdistill.misc.log\tEpoch: [111] Total time: 0:00:16\n",
            "2021/05/21 22:08:45\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:42  acc1: 92.9688 (92.9688)  acc5: 100.0000 (100.0000)  time: 0.5377  data: 0.5264  max mem: 281\n",
            "2021/05/21 22:08:47\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:08:47\tINFO\t__main__\t * Acc@1 91.6300\tAcc@5 99.7900\n",
            "\n",
            "2021/05/21 22:08:48\tINFO\ttorchdistill.misc.log\tEpoch: [112]  [  0/391]  eta: 0:04:48  lr: 0.010000000000000002  img/s: 1151.5645567448146  loss: 0.0700 (0.0700)  time: 0.7369  data: 0.6258  max mem: 281\n",
            "2021/05/21 22:08:53\tINFO\ttorchdistill.misc.log\tEpoch: [112]  [100/391]  eta: 0:00:15  lr: 0.010000000000000002  img/s: 3524.926050673968  loss: 0.0346 (0.0454)  time: 0.0381  data: 0.0046  max mem: 281\n",
            "2021/05/21 22:08:57\tINFO\ttorchdistill.misc.log\tEpoch: [112]  [200/391]  eta: 0:00:08  lr: 0.010000000000000002  img/s: 5087.184338696534  loss: 0.0336 (0.0446)  time: 0.0371  data: 0.0037  max mem: 281\n",
            "2021/05/21 22:09:01\tINFO\ttorchdistill.misc.log\tEpoch: [112]  [300/391]  eta: 0:00:03  lr: 0.010000000000000002  img/s: 3596.498512821887  loss: 0.0436 (0.0454)  time: 0.0383  data: 0.0038  max mem: 281\n",
            "2021/05/21 22:09:04\tINFO\ttorchdistill.misc.log\tEpoch: [112] Total time: 0:00:16\n",
            "2021/05/21 22:09:05\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:46  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5903  data: 0.5414  max mem: 281\n",
            "2021/05/21 22:09:06\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:09:06\tINFO\t__main__\t * Acc@1 91.8200\tAcc@5 99.7600\n",
            "\n",
            "2021/05/21 22:09:07\tINFO\ttorchdistill.misc.log\tEpoch: [113]  [  0/391]  eta: 0:04:51  lr: 0.010000000000000002  img/s: 1137.3130756781034  loss: 0.0421 (0.0421)  time: 0.7446  data: 0.6321  max mem: 281\n",
            "2021/05/21 22:09:12\tINFO\ttorchdistill.misc.log\tEpoch: [113]  [100/391]  eta: 0:00:15  lr: 0.010000000000000002  img/s: 3055.0896944175724  loss: 0.0477 (0.0479)  time: 0.0389  data: 0.0038  max mem: 281\n",
            "2021/05/21 22:09:16\tINFO\ttorchdistill.misc.log\tEpoch: [113]  [200/391]  eta: 0:00:08  lr: 0.010000000000000002  img/s: 3385.2119072090195  loss: 0.0474 (0.0460)  time: 0.0400  data: 0.0054  max mem: 281\n",
            "2021/05/21 22:09:20\tINFO\ttorchdistill.misc.log\tEpoch: [113]  [300/391]  eta: 0:00:04  lr: 0.010000000000000002  img/s: 5442.399205238935  loss: 0.0362 (0.0453)  time: 0.0393  data: 0.0055  max mem: 281\n",
            "2021/05/21 22:09:23\tINFO\ttorchdistill.misc.log\tEpoch: [113] Total time: 0:00:16\n",
            "2021/05/21 22:09:24\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 92.9688 (92.9688)  acc5: 100.0000 (100.0000)  time: 0.5579  data: 0.5123  max mem: 281\n",
            "2021/05/21 22:09:26\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:09:26\tINFO\t__main__\t * Acc@1 91.7300\tAcc@5 99.7700\n",
            "\n",
            "2021/05/21 22:09:26\tINFO\ttorchdistill.misc.log\tEpoch: [114]  [  0/391]  eta: 0:04:09  lr: 0.010000000000000002  img/s: 1144.9289248302453  loss: 0.1064 (0.1064)  time: 0.6373  data: 0.5255  max mem: 281\n",
            "2021/05/21 22:09:31\tINFO\ttorchdistill.misc.log\tEpoch: [114]  [100/391]  eta: 0:00:15  lr: 0.010000000000000002  img/s: 4030.471626014429  loss: 0.0404 (0.0444)  time: 0.0392  data: 0.0056  max mem: 281\n",
            "2021/05/21 22:09:35\tINFO\ttorchdistill.misc.log\tEpoch: [114]  [200/391]  eta: 0:00:08  lr: 0.010000000000000002  img/s: 3196.649629647272  loss: 0.0323 (0.0428)  time: 0.0418  data: 0.0050  max mem: 281\n",
            "2021/05/21 22:09:39\tINFO\ttorchdistill.misc.log\tEpoch: [114]  [300/391]  eta: 0:00:04  lr: 0.010000000000000002  img/s: 4413.713853514967  loss: 0.0496 (0.0440)  time: 0.0383  data: 0.0067  max mem: 281\n",
            "2021/05/21 22:09:42\tINFO\ttorchdistill.misc.log\tEpoch: [114] Total time: 0:00:16\n",
            "2021/05/21 22:09:43\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:47  acc1: 92.1875 (92.1875)  acc5: 100.0000 (100.0000)  time: 0.6017  data: 0.5511  max mem: 281\n",
            "2021/05/21 22:09:45\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:09:45\tINFO\t__main__\t * Acc@1 91.5600\tAcc@5 99.7800\n",
            "\n",
            "2021/05/21 22:09:46\tINFO\ttorchdistill.misc.log\tEpoch: [115]  [  0/391]  eta: 0:05:10  lr: 0.010000000000000002  img/s: 1075.1265870441127  loss: 0.0185 (0.0185)  time: 0.7937  data: 0.6746  max mem: 281\n",
            "2021/05/21 22:09:50\tINFO\ttorchdistill.misc.log\tEpoch: [115]  [100/391]  eta: 0:00:15  lr: 0.010000000000000002  img/s: 3132.269031505251  loss: 0.0348 (0.0407)  time: 0.0396  data: 0.0045  max mem: 281\n",
            "2021/05/21 22:09:54\tINFO\ttorchdistill.misc.log\tEpoch: [115]  [200/391]  eta: 0:00:08  lr: 0.010000000000000002  img/s: 5573.710180436453  loss: 0.0375 (0.0407)  time: 0.0389  data: 0.0056  max mem: 281\n",
            "2021/05/21 22:09:58\tINFO\ttorchdistill.misc.log\tEpoch: [115]  [300/391]  eta: 0:00:03  lr: 0.010000000000000002  img/s: 2910.6582380048794  loss: 0.0395 (0.0420)  time: 0.0419  data: 0.0060  max mem: 281\n",
            "2021/05/21 22:10:01\tINFO\ttorchdistill.misc.log\tEpoch: [115] Total time: 0:00:16\n",
            "2021/05/21 22:10:02\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 92.1875 (92.1875)  acc5: 100.0000 (100.0000)  time: 0.5613  data: 0.5227  max mem: 281\n",
            "2021/05/21 22:10:04\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:10:04\tINFO\t__main__\t * Acc@1 91.6100\tAcc@5 99.8000\n",
            "\n",
            "2021/05/21 22:10:04\tINFO\ttorchdistill.misc.log\tEpoch: [116]  [  0/391]  eta: 0:05:04  lr: 0.010000000000000002  img/s: 1276.3343801633246  loss: 0.0246 (0.0246)  time: 0.7787  data: 0.6784  max mem: 281\n",
            "2021/05/21 22:10:10\tINFO\ttorchdistill.misc.log\tEpoch: [116]  [100/391]  eta: 0:00:16  lr: 0.010000000000000002  img/s: 2472.100049730168  loss: 0.0352 (0.0424)  time: 0.0400  data: 0.0031  max mem: 281\n",
            "2021/05/21 22:10:14\tINFO\ttorchdistill.misc.log\tEpoch: [116]  [200/391]  eta: 0:00:09  lr: 0.010000000000000002  img/s: 4123.59085986405  loss: 0.0392 (0.0421)  time: 0.0399  data: 0.0044  max mem: 281\n",
            "2021/05/21 22:10:18\tINFO\ttorchdistill.misc.log\tEpoch: [116]  [300/391]  eta: 0:00:04  lr: 0.010000000000000002  img/s: 3642.593390190451  loss: 0.0352 (0.0422)  time: 0.0401  data: 0.0035  max mem: 281\n",
            "2021/05/21 22:10:21\tINFO\ttorchdistill.misc.log\tEpoch: [116] Total time: 0:00:17\n",
            "2021/05/21 22:10:21\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5601  data: 0.5355  max mem: 281\n",
            "2021/05/21 22:10:23\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:10:23\tINFO\t__main__\t * Acc@1 91.8300\tAcc@5 99.7700\n",
            "\n",
            "2021/05/21 22:10:24\tINFO\ttorchdistill.misc.log\tEpoch: [117]  [  0/391]  eta: 0:05:20  lr: 0.010000000000000002  img/s: 1210.5264733868166  loss: 0.0654 (0.0654)  time: 0.8188  data: 0.7130  max mem: 281\n",
            "2021/05/21 22:10:29\tINFO\ttorchdistill.misc.log\tEpoch: [117]  [100/391]  eta: 0:00:15  lr: 0.010000000000000002  img/s: 2629.0266932407485  loss: 0.0427 (0.0401)  time: 0.0376  data: 0.0035  max mem: 281\n",
            "2021/05/21 22:10:33\tINFO\ttorchdistill.misc.log\tEpoch: [117]  [200/391]  eta: 0:00:08  lr: 0.010000000000000002  img/s: 3773.155045787739  loss: 0.0345 (0.0411)  time: 0.0393  data: 0.0058  max mem: 281\n",
            "2021/05/21 22:10:37\tINFO\ttorchdistill.misc.log\tEpoch: [117]  [300/391]  eta: 0:00:03  lr: 0.010000000000000002  img/s: 3304.390368802009  loss: 0.0509 (0.0418)  time: 0.0383  data: 0.0042  max mem: 281\n",
            "2021/05/21 22:10:40\tINFO\ttorchdistill.misc.log\tEpoch: [117] Total time: 0:00:16\n",
            "2021/05/21 22:10:41\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:45  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5784  data: 0.5479  max mem: 281\n",
            "2021/05/21 22:10:42\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:10:42\tINFO\t__main__\t * Acc@1 91.8100\tAcc@5 99.7400\n",
            "\n",
            "2021/05/21 22:10:43\tINFO\ttorchdistill.misc.log\tEpoch: [118]  [  0/391]  eta: 0:06:10  lr: 0.010000000000000002  img/s: 1044.075463772372  loss: 0.0320 (0.0320)  time: 0.9482  data: 0.8256  max mem: 281\n",
            "2021/05/21 22:10:48\tINFO\ttorchdistill.misc.log\tEpoch: [118]  [100/391]  eta: 0:00:15  lr: 0.010000000000000002  img/s: 3489.528325923615  loss: 0.0289 (0.0380)  time: 0.0395  data: 0.0038  max mem: 281\n",
            "2021/05/21 22:10:52\tINFO\ttorchdistill.misc.log\tEpoch: [118]  [200/391]  eta: 0:00:08  lr: 0.010000000000000002  img/s: 2421.2276456130066  loss: 0.0388 (0.0409)  time: 0.0407  data: 0.0056  max mem: 281\n",
            "2021/05/21 22:10:56\tINFO\ttorchdistill.misc.log\tEpoch: [118]  [300/391]  eta: 0:00:04  lr: 0.010000000000000002  img/s: 3121.0340373335193  loss: 0.0303 (0.0415)  time: 0.0393  data: 0.0041  max mem: 281\n",
            "2021/05/21 22:10:59\tINFO\ttorchdistill.misc.log\tEpoch: [118] Total time: 0:00:16\n",
            "2021/05/21 22:11:00\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:46  acc1: 94.5312 (94.5312)  acc5: 100.0000 (100.0000)  time: 0.5907  data: 0.5376  max mem: 281\n",
            "2021/05/21 22:11:02\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:11:02\tINFO\t__main__\t * Acc@1 91.4300\tAcc@5 99.7100\n",
            "\n",
            "2021/05/21 22:11:02\tINFO\ttorchdistill.misc.log\tEpoch: [119]  [  0/391]  eta: 0:04:06  lr: 0.010000000000000002  img/s: 1139.287301001201  loss: 0.0234 (0.0234)  time: 0.6301  data: 0.5177  max mem: 281\n",
            "2021/05/21 22:11:07\tINFO\ttorchdistill.misc.log\tEpoch: [119]  [100/391]  eta: 0:00:15  lr: 0.010000000000000002  img/s: 4030.9255488482445  loss: 0.0374 (0.0369)  time: 0.0409  data: 0.0059  max mem: 281\n",
            "2021/05/21 22:11:11\tINFO\ttorchdistill.misc.log\tEpoch: [119]  [200/391]  eta: 0:00:08  lr: 0.010000000000000002  img/s: 2617.3759104515448  loss: 0.0392 (0.0381)  time: 0.0394  data: 0.0056  max mem: 281\n",
            "2021/05/21 22:11:15\tINFO\ttorchdistill.misc.log\tEpoch: [119]  [300/391]  eta: 0:00:03  lr: 0.010000000000000002  img/s: 4977.110097526606  loss: 0.0366 (0.0387)  time: 0.0376  data: 0.0056  max mem: 281\n",
            "2021/05/21 22:11:18\tINFO\ttorchdistill.misc.log\tEpoch: [119] Total time: 0:00:16\n",
            "2021/05/21 22:11:19\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 92.9688 (92.9688)  acc5: 100.0000 (100.0000)  time: 0.5638  data: 0.5472  max mem: 281\n",
            "2021/05/21 22:11:21\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:11:21\tINFO\t__main__\t * Acc@1 91.6600\tAcc@5 99.7500\n",
            "\n",
            "2021/05/21 22:11:22\tINFO\ttorchdistill.misc.log\tEpoch: [120]  [  0/391]  eta: 0:06:03  lr: 0.010000000000000002  img/s: 1087.3356948571036  loss: 0.0183 (0.0183)  time: 0.9290  data: 0.8112  max mem: 281\n",
            "2021/05/21 22:11:26\tINFO\ttorchdistill.misc.log\tEpoch: [120]  [100/391]  eta: 0:00:15  lr: 0.010000000000000002  img/s: 3145.887752112412  loss: 0.0432 (0.0402)  time: 0.0392  data: 0.0049  max mem: 281\n",
            "2021/05/21 22:11:30\tINFO\ttorchdistill.misc.log\tEpoch: [120]  [200/391]  eta: 0:00:08  lr: 0.010000000000000002  img/s: 2743.9251755614387  loss: 0.0282 (0.0399)  time: 0.0376  data: 0.0051  max mem: 281\n",
            "2021/05/21 22:11:34\tINFO\ttorchdistill.misc.log\tEpoch: [120]  [300/391]  eta: 0:00:03  lr: 0.010000000000000002  img/s: 4000.111106143919  loss: 0.0276 (0.0397)  time: 0.0388  data: 0.0062  max mem: 281\n",
            "2021/05/21 22:11:37\tINFO\ttorchdistill.misc.log\tEpoch: [120] Total time: 0:00:16\n",
            "2021/05/21 22:11:38\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:46  acc1: 94.5312 (94.5312)  acc5: 100.0000 (100.0000)  time: 0.5849  data: 0.5368  max mem: 281\n",
            "2021/05/21 22:11:40\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:11:40\tINFO\t__main__\t * Acc@1 91.6700\tAcc@5 99.7800\n",
            "\n",
            "2021/05/21 22:11:41\tINFO\ttorchdistill.misc.log\tEpoch: [121]  [  0/391]  eta: 0:05:04  lr: 0.010000000000000002  img/s: 1212.8345404352797  loss: 0.0456 (0.0456)  time: 0.7776  data: 0.6720  max mem: 281\n",
            "2021/05/21 22:11:45\tINFO\ttorchdistill.misc.log\tEpoch: [121]  [100/391]  eta: 0:00:15  lr: 0.010000000000000002  img/s: 4668.117974401781  loss: 0.0322 (0.0348)  time: 0.0396  data: 0.0049  max mem: 281\n",
            "2021/05/21 22:11:49\tINFO\ttorchdistill.misc.log\tEpoch: [121]  [200/391]  eta: 0:00:08  lr: 0.010000000000000002  img/s: 4995.030861268503  loss: 0.0358 (0.0368)  time: 0.0406  data: 0.0056  max mem: 281\n",
            "2021/05/21 22:11:53\tINFO\ttorchdistill.misc.log\tEpoch: [121]  [300/391]  eta: 0:00:03  lr: 0.010000000000000002  img/s: 3514.059039914124  loss: 0.0351 (0.0370)  time: 0.0412  data: 0.0053  max mem: 281\n",
            "2021/05/21 22:11:56\tINFO\ttorchdistill.misc.log\tEpoch: [121] Total time: 0:00:16\n",
            "2021/05/21 22:11:57\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5631  data: 0.5345  max mem: 281\n",
            "2021/05/21 22:11:59\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:11:59\tINFO\t__main__\t * Acc@1 91.8100\tAcc@5 99.8100\n",
            "\n",
            "2021/05/21 22:12:00\tINFO\ttorchdistill.misc.log\tEpoch: [122]  [  0/391]  eta: 0:05:35  lr: 0.010000000000000002  img/s: 1192.0477999542607  loss: 0.0576 (0.0576)  time: 0.8576  data: 0.7502  max mem: 281\n",
            "2021/05/21 22:12:04\tINFO\ttorchdistill.misc.log\tEpoch: [122]  [100/391]  eta: 0:00:15  lr: 0.010000000000000002  img/s: 3877.6401522538335  loss: 0.0389 (0.0399)  time: 0.0395  data: 0.0046  max mem: 281\n",
            "2021/05/21 22:12:08\tINFO\ttorchdistill.misc.log\tEpoch: [122]  [200/391]  eta: 0:00:08  lr: 0.010000000000000002  img/s: 4485.174579570423  loss: 0.0343 (0.0385)  time: 0.0392  data: 0.0048  max mem: 281\n",
            "2021/05/21 22:12:12\tINFO\ttorchdistill.misc.log\tEpoch: [122]  [300/391]  eta: 0:00:04  lr: 0.010000000000000002  img/s: 4116.098135426889  loss: 0.0406 (0.0395)  time: 0.0402  data: 0.0058  max mem: 281\n",
            "2021/05/21 22:12:15\tINFO\ttorchdistill.misc.log\tEpoch: [122] Total time: 0:00:16\n",
            "2021/05/21 22:12:16\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:48  acc1: 95.3125 (95.3125)  acc5: 100.0000 (100.0000)  time: 0.6148  data: 0.5615  max mem: 281\n",
            "2021/05/21 22:12:18\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:12:18\tINFO\t__main__\t * Acc@1 91.7100\tAcc@5 99.7700\n",
            "\n",
            "2021/05/21 22:12:18\tINFO\ttorchdistill.misc.log\tEpoch: [123]  [  0/391]  eta: 0:04:36  lr: 0.010000000000000002  img/s: 1134.4028838087913  loss: 0.0181 (0.0181)  time: 0.7068  data: 0.5940  max mem: 281\n",
            "2021/05/21 22:12:23\tINFO\ttorchdistill.misc.log\tEpoch: [123]  [100/391]  eta: 0:00:15  lr: 0.010000000000000002  img/s: 3343.906721809756  loss: 0.0294 (0.0360)  time: 0.0409  data: 0.0047  max mem: 281\n",
            "2021/05/21 22:12:27\tINFO\ttorchdistill.misc.log\tEpoch: [123]  [200/391]  eta: 0:00:08  lr: 0.010000000000000002  img/s: 3879.2091736092543  loss: 0.0247 (0.0355)  time: 0.0395  data: 0.0044  max mem: 281\n",
            "2021/05/21 22:12:31\tINFO\ttorchdistill.misc.log\tEpoch: [123]  [300/391]  eta: 0:00:04  lr: 0.010000000000000002  img/s: 3153.297144904468  loss: 0.0352 (0.0367)  time: 0.0398  data: 0.0047  max mem: 281\n",
            "2021/05/21 22:12:34\tINFO\ttorchdistill.misc.log\tEpoch: [123] Total time: 0:00:16\n",
            "2021/05/21 22:12:35\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 94.5312 (94.5312)  acc5: 100.0000 (100.0000)  time: 0.5614  data: 0.5311  max mem: 281\n",
            "2021/05/21 22:12:37\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:12:37\tINFO\t__main__\t * Acc@1 91.8200\tAcc@5 99.7700\n",
            "\n",
            "2021/05/21 22:12:38\tINFO\ttorchdistill.misc.log\tEpoch: [124]  [  0/391]  eta: 0:06:16  lr: 0.010000000000000002  img/s: 1108.3008614621115  loss: 0.0211 (0.0211)  time: 0.9631  data: 0.8476  max mem: 281\n",
            "2021/05/21 22:12:42\tINFO\ttorchdistill.misc.log\tEpoch: [124]  [100/391]  eta: 0:00:15  lr: 0.010000000000000002  img/s: 3555.9545894103776  loss: 0.0338 (0.0373)  time: 0.0402  data: 0.0047  max mem: 281\n",
            "2021/05/21 22:12:46\tINFO\ttorchdistill.misc.log\tEpoch: [124]  [200/391]  eta: 0:00:08  lr: 0.010000000000000002  img/s: 3411.3466431140314  loss: 0.0273 (0.0370)  time: 0.0400  data: 0.0035  max mem: 281\n",
            "2021/05/21 22:12:50\tINFO\ttorchdistill.misc.log\tEpoch: [124]  [300/391]  eta: 0:00:03  lr: 0.010000000000000002  img/s: 4199.323503875727  loss: 0.0202 (0.0360)  time: 0.0396  data: 0.0042  max mem: 281\n",
            "2021/05/21 22:12:53\tINFO\ttorchdistill.misc.log\tEpoch: [124] Total time: 0:00:16\n",
            "2021/05/21 22:12:54\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:47  acc1: 94.5312 (94.5312)  acc5: 100.0000 (100.0000)  time: 0.6045  data: 0.5676  max mem: 281\n",
            "2021/05/21 22:12:56\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:12:56\tINFO\t__main__\t * Acc@1 91.7200\tAcc@5 99.7200\n",
            "\n",
            "2021/05/21 22:12:57\tINFO\ttorchdistill.misc.log\tEpoch: [125]  [  0/391]  eta: 0:04:44  lr: 0.010000000000000002  img/s: 1298.9294248012427  loss: 0.0250 (0.0250)  time: 0.7265  data: 0.6280  max mem: 281\n",
            "2021/05/21 22:13:01\tINFO\ttorchdistill.misc.log\tEpoch: [125]  [100/391]  eta: 0:00:15  lr: 0.010000000000000002  img/s: 2841.293401004483  loss: 0.0302 (0.0335)  time: 0.0392  data: 0.0051  max mem: 281\n",
            "2021/05/21 22:13:05\tINFO\ttorchdistill.misc.log\tEpoch: [125]  [200/391]  eta: 0:00:08  lr: 0.010000000000000002  img/s: 4234.164691036713  loss: 0.0295 (0.0346)  time: 0.0391  data: 0.0048  max mem: 281\n",
            "2021/05/21 22:13:09\tINFO\ttorchdistill.misc.log\tEpoch: [125]  [300/391]  eta: 0:00:03  lr: 0.010000000000000002  img/s: 3260.323268637501  loss: 0.0431 (0.0355)  time: 0.0409  data: 0.0058  max mem: 281\n",
            "2021/05/21 22:13:12\tINFO\ttorchdistill.misc.log\tEpoch: [125] Total time: 0:00:16\n",
            "2021/05/21 22:13:13\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:42  acc1: 94.5312 (94.5312)  acc5: 100.0000 (100.0000)  time: 0.5400  data: 0.5101  max mem: 281\n",
            "2021/05/21 22:13:15\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:13:15\tINFO\t__main__\t * Acc@1 91.6800\tAcc@5 99.7300\n",
            "\n",
            "2021/05/21 22:13:16\tINFO\ttorchdistill.misc.log\tEpoch: [126]  [  0/391]  eta: 0:04:10  lr: 0.010000000000000002  img/s: 1188.2722572420143  loss: 0.0228 (0.0228)  time: 0.6419  data: 0.5341  max mem: 281\n",
            "2021/05/21 22:13:20\tINFO\ttorchdistill.misc.log\tEpoch: [126]  [100/391]  eta: 0:00:15  lr: 0.010000000000000002  img/s: 3275.6204247737937  loss: 0.0351 (0.0342)  time: 0.0401  data: 0.0041  max mem: 281\n",
            "2021/05/21 22:13:24\tINFO\ttorchdistill.misc.log\tEpoch: [126]  [200/391]  eta: 0:00:08  lr: 0.010000000000000002  img/s: 2601.01794504089  loss: 0.0348 (0.0352)  time: 0.0404  data: 0.0046  max mem: 281\n",
            "2021/05/21 22:13:28\tINFO\ttorchdistill.misc.log\tEpoch: [126]  [300/391]  eta: 0:00:04  lr: 0.010000000000000002  img/s: 3657.158801089918  loss: 0.0273 (0.0356)  time: 0.0410  data: 0.0051  max mem: 281\n",
            "2021/05/21 22:13:32\tINFO\ttorchdistill.misc.log\tEpoch: [126] Total time: 0:00:16\n",
            "2021/05/21 22:13:32\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:46  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5902  data: 0.5383  max mem: 281\n",
            "2021/05/21 22:13:34\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:13:34\tINFO\t__main__\t * Acc@1 91.7200\tAcc@5 99.7300\n",
            "\n",
            "2021/05/21 22:13:35\tINFO\ttorchdistill.misc.log\tEpoch: [127]  [  0/391]  eta: 0:04:55  lr: 0.010000000000000002  img/s: 1186.1771872224408  loss: 0.0602 (0.0602)  time: 0.7556  data: 0.6477  max mem: 281\n",
            "2021/05/21 22:13:40\tINFO\ttorchdistill.misc.log\tEpoch: [127]  [100/391]  eta: 0:00:15  lr: 0.010000000000000002  img/s: 3058.9192182781608  loss: 0.0368 (0.0326)  time: 0.0397  data: 0.0050  max mem: 281\n",
            "2021/05/21 22:13:44\tINFO\ttorchdistill.misc.log\tEpoch: [127]  [200/391]  eta: 0:00:08  lr: 0.010000000000000002  img/s: 3598.2340419827888  loss: 0.0278 (0.0344)  time: 0.0412  data: 0.0041  max mem: 281\n",
            "2021/05/21 22:13:48\tINFO\ttorchdistill.misc.log\tEpoch: [127]  [300/391]  eta: 0:00:04  lr: 0.010000000000000002  img/s: 2909.8694417344173  loss: 0.0390 (0.0349)  time: 0.0386  data: 0.0043  max mem: 281\n",
            "2021/05/21 22:13:51\tINFO\ttorchdistill.misc.log\tEpoch: [127] Total time: 0:00:16\n",
            "2021/05/21 22:13:52\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:54  acc1: 95.3125 (95.3125)  acc5: 100.0000 (100.0000)  time: 0.6941  data: 0.6706  max mem: 281\n",
            "2021/05/21 22:13:53\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:13:53\tINFO\t__main__\t * Acc@1 91.8200\tAcc@5 99.7600\n",
            "\n",
            "2021/05/21 22:13:54\tINFO\ttorchdistill.misc.log\tEpoch: [128]  [  0/391]  eta: 0:04:39  lr: 0.010000000000000002  img/s: 1151.7770207069364  loss: 0.0097 (0.0097)  time: 0.7143  data: 0.6031  max mem: 281\n",
            "2021/05/21 22:13:59\tINFO\ttorchdistill.misc.log\tEpoch: [128]  [100/391]  eta: 0:00:15  lr: 0.010000000000000002  img/s: 3272.764974823521  loss: 0.0223 (0.0325)  time: 0.0419  data: 0.0046  max mem: 281\n",
            "2021/05/21 22:14:03\tINFO\ttorchdistill.misc.log\tEpoch: [128]  [200/391]  eta: 0:00:08  lr: 0.010000000000000002  img/s: 3856.111013747432  loss: 0.0341 (0.0341)  time: 0.0408  data: 0.0065  max mem: 281\n",
            "2021/05/21 22:14:07\tINFO\ttorchdistill.misc.log\tEpoch: [128]  [300/391]  eta: 0:00:04  lr: 0.010000000000000002  img/s: 5284.11051072332  loss: 0.0276 (0.0338)  time: 0.0394  data: 0.0047  max mem: 281\n",
            "2021/05/21 22:14:10\tINFO\ttorchdistill.misc.log\tEpoch: [128] Total time: 0:00:16\n",
            "2021/05/21 22:14:11\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:45  acc1: 94.5312 (94.5312)  acc5: 100.0000 (100.0000)  time: 0.5817  data: 0.5441  max mem: 281\n",
            "2021/05/21 22:14:13\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:14:13\tINFO\t__main__\t * Acc@1 91.5800\tAcc@5 99.7700\n",
            "\n",
            "2021/05/21 22:14:13\tINFO\ttorchdistill.misc.log\tEpoch: [129]  [  0/391]  eta: 0:04:57  lr: 0.010000000000000002  img/s: 1134.8369035389214  loss: 0.0415 (0.0415)  time: 0.7602  data: 0.6474  max mem: 281\n",
            "2021/05/21 22:14:18\tINFO\ttorchdistill.misc.log\tEpoch: [129]  [100/391]  eta: 0:00:15  lr: 0.010000000000000002  img/s: 4380.081030586354  loss: 0.0239 (0.0335)  time: 0.0375  data: 0.0040  max mem: 281\n",
            "2021/05/21 22:14:22\tINFO\ttorchdistill.misc.log\tEpoch: [129]  [200/391]  eta: 0:00:08  lr: 0.010000000000000002  img/s: 3121.487697102191  loss: 0.0384 (0.0347)  time: 0.0401  data: 0.0058  max mem: 281\n",
            "2021/05/21 22:14:26\tINFO\ttorchdistill.misc.log\tEpoch: [129]  [300/391]  eta: 0:00:03  lr: 0.010000000000000002  img/s: 3071.3614608779226  loss: 0.0305 (0.0342)  time: 0.0381  data: 0.0056  max mem: 281\n",
            "2021/05/21 22:14:29\tINFO\ttorchdistill.misc.log\tEpoch: [129] Total time: 0:00:16\n",
            "2021/05/21 22:14:30\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:51  acc1: 94.5312 (94.5312)  acc5: 100.0000 (100.0000)  time: 0.6465  data: 0.6177  max mem: 281\n",
            "2021/05/21 22:14:31\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:14:31\tINFO\t__main__\t * Acc@1 91.6100\tAcc@5 99.7200\n",
            "\n",
            "2021/05/21 22:14:32\tINFO\ttorchdistill.misc.log\tEpoch: [130]  [  0/391]  eta: 0:04:22  lr: 0.010000000000000002  img/s: 958.4190887295305  loss: 0.0164 (0.0164)  time: 0.6718  data: 0.5382  max mem: 281\n",
            "2021/05/21 22:14:37\tINFO\ttorchdistill.misc.log\tEpoch: [130]  [100/391]  eta: 0:00:15  lr: 0.010000000000000002  img/s: 3843.1373267666936  loss: 0.0281 (0.0334)  time: 0.0397  data: 0.0050  max mem: 281\n",
            "2021/05/21 22:14:41\tINFO\ttorchdistill.misc.log\tEpoch: [130]  [200/391]  eta: 0:00:08  lr: 0.010000000000000002  img/s: 2873.0723150115327  loss: 0.0265 (0.0332)  time: 0.0388  data: 0.0051  max mem: 281\n",
            "2021/05/21 22:14:45\tINFO\ttorchdistill.misc.log\tEpoch: [130]  [300/391]  eta: 0:00:03  lr: 0.010000000000000002  img/s: 4341.297624245953  loss: 0.0405 (0.0333)  time: 0.0407  data: 0.0038  max mem: 281\n",
            "2021/05/21 22:14:48\tINFO\ttorchdistill.misc.log\tEpoch: [130] Total time: 0:00:16\n",
            "2021/05/21 22:14:49\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:47  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.6023  data: 0.5326  max mem: 281\n",
            "2021/05/21 22:14:51\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:14:51\tINFO\t__main__\t * Acc@1 91.8300\tAcc@5 99.7000\n",
            "\n",
            "2021/05/21 22:14:51\tINFO\ttorchdistill.misc.log\tEpoch: [131]  [  0/391]  eta: 0:05:26  lr: 0.010000000000000002  img/s: 1099.5910094501542  loss: 0.0557 (0.0557)  time: 0.8363  data: 0.7198  max mem: 281\n",
            "2021/05/21 22:14:56\tINFO\ttorchdistill.misc.log\tEpoch: [131]  [100/391]  eta: 0:00:15  lr: 0.010000000000000002  img/s: 3487.7827569853634  loss: 0.0232 (0.0278)  time: 0.0425  data: 0.0059  max mem: 281\n",
            "2021/05/21 22:15:00\tINFO\ttorchdistill.misc.log\tEpoch: [131]  [200/391]  eta: 0:00:08  lr: 0.010000000000000002  img/s: 3855.197236803366  loss: 0.0282 (0.0301)  time: 0.0392  data: 0.0049  max mem: 281\n",
            "2021/05/21 22:15:04\tINFO\ttorchdistill.misc.log\tEpoch: [131]  [300/391]  eta: 0:00:03  lr: 0.010000000000000002  img/s: 4164.921778391504  loss: 0.0267 (0.0311)  time: 0.0403  data: 0.0044  max mem: 281\n",
            "2021/05/21 22:15:07\tINFO\ttorchdistill.misc.log\tEpoch: [131] Total time: 0:00:16\n",
            "2021/05/21 22:15:08\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:45  acc1: 92.1875 (92.1875)  acc5: 100.0000 (100.0000)  time: 0.5780  data: 0.5403  max mem: 281\n",
            "2021/05/21 22:15:09\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:15:09\tINFO\t__main__\t * Acc@1 91.5300\tAcc@5 99.7200\n",
            "\n",
            "2021/05/21 22:15:10\tINFO\ttorchdistill.misc.log\tEpoch: [132]  [  0/391]  eta: 0:06:03  lr: 0.010000000000000002  img/s: 1222.6871240813407  loss: 0.0134 (0.0134)  time: 0.9305  data: 0.8258  max mem: 281\n",
            "2021/05/21 22:15:15\tINFO\ttorchdistill.misc.log\tEpoch: [132]  [100/391]  eta: 0:00:15  lr: 0.010000000000000002  img/s: 5311.294031519276  loss: 0.0213 (0.0291)  time: 0.0398  data: 0.0055  max mem: 281\n",
            "2021/05/21 22:15:19\tINFO\ttorchdistill.misc.log\tEpoch: [132]  [200/391]  eta: 0:00:08  lr: 0.010000000000000002  img/s: 2938.618528148006  loss: 0.0355 (0.0320)  time: 0.0389  data: 0.0049  max mem: 281\n",
            "2021/05/21 22:15:23\tINFO\ttorchdistill.misc.log\tEpoch: [132]  [300/391]  eta: 0:00:03  lr: 0.010000000000000002  img/s: 4109.639014980442  loss: 0.0292 (0.0319)  time: 0.0365  data: 0.0039  max mem: 281\n",
            "2021/05/21 22:15:26\tINFO\ttorchdistill.misc.log\tEpoch: [132] Total time: 0:00:16\n",
            "2021/05/21 22:15:27\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 94.5312 (94.5312)  acc5: 100.0000 (100.0000)  time: 0.5661  data: 0.5413  max mem: 281\n",
            "2021/05/21 22:15:29\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:15:29\tINFO\t__main__\t * Acc@1 91.7800\tAcc@5 99.7000\n",
            "\n",
            "2021/05/21 22:15:29\tINFO\ttorchdistill.misc.log\tEpoch: [133]  [  0/391]  eta: 0:05:26  lr: 0.010000000000000002  img/s: 1123.1844013473085  loss: 0.0228 (0.0228)  time: 0.8361  data: 0.7221  max mem: 281\n",
            "2021/05/21 22:15:34\tINFO\ttorchdistill.misc.log\tEpoch: [133]  [100/391]  eta: 0:00:15  lr: 0.010000000000000002  img/s: 3347.785141488844  loss: 0.0195 (0.0302)  time: 0.0384  data: 0.0051  max mem: 281\n",
            "2021/05/21 22:15:38\tINFO\ttorchdistill.misc.log\tEpoch: [133]  [200/391]  eta: 0:00:08  lr: 0.010000000000000002  img/s: 2501.751703184559  loss: 0.0282 (0.0329)  time: 0.0397  data: 0.0052  max mem: 281\n",
            "2021/05/21 22:15:42\tINFO\ttorchdistill.misc.log\tEpoch: [133]  [300/391]  eta: 0:00:03  lr: 0.010000000000000002  img/s: 4648.313494605967  loss: 0.0286 (0.0320)  time: 0.0375  data: 0.0034  max mem: 281\n",
            "2021/05/21 22:15:45\tINFO\ttorchdistill.misc.log\tEpoch: [133] Total time: 0:00:16\n",
            "2021/05/21 22:15:46\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:42  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5410  data: 0.5017  max mem: 281\n",
            "2021/05/21 22:15:47\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:15:47\tINFO\t__main__\t * Acc@1 91.8700\tAcc@5 99.7000\n",
            "\n",
            "2021/05/21 22:15:48\tINFO\ttorchdistill.misc.log\tEpoch: [134]  [  0/391]  eta: 0:05:37  lr: 0.010000000000000002  img/s: 1222.2779267731844  loss: 0.0172 (0.0172)  time: 0.8629  data: 0.7582  max mem: 281\n",
            "2021/05/21 22:15:53\tINFO\ttorchdistill.misc.log\tEpoch: [134]  [100/391]  eta: 0:00:15  lr: 0.010000000000000002  img/s: 4028.68718764539  loss: 0.0204 (0.0300)  time: 0.0389  data: 0.0067  max mem: 281\n",
            "2021/05/21 22:15:57\tINFO\ttorchdistill.misc.log\tEpoch: [134]  [200/391]  eta: 0:00:08  lr: 0.010000000000000002  img/s: 2976.2998081848523  loss: 0.0292 (0.0287)  time: 0.0413  data: 0.0049  max mem: 281\n",
            "2021/05/21 22:16:01\tINFO\ttorchdistill.misc.log\tEpoch: [134]  [300/391]  eta: 0:00:03  lr: 0.010000000000000002  img/s: 4823.551346786221  loss: 0.0277 (0.0292)  time: 0.0376  data: 0.0051  max mem: 281\n",
            "2021/05/21 22:16:04\tINFO\ttorchdistill.misc.log\tEpoch: [134] Total time: 0:00:16\n",
            "2021/05/21 22:16:05\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5616  data: 0.5243  max mem: 281\n",
            "2021/05/21 22:16:06\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:16:06\tINFO\t__main__\t * Acc@1 91.5600\tAcc@5 99.7000\n",
            "\n",
            "2021/05/21 22:16:07\tINFO\ttorchdistill.misc.log\tEpoch: [135]  [  0/391]  eta: 0:03:54  lr: 0.010000000000000002  img/s: 1567.9732708719093  loss: 0.0187 (0.0187)  time: 0.5999  data: 0.5182  max mem: 281\n",
            "2021/05/21 22:16:12\tINFO\ttorchdistill.misc.log\tEpoch: [135]  [100/391]  eta: 0:00:15  lr: 0.010000000000000002  img/s: 5222.632100158565  loss: 0.0237 (0.0286)  time: 0.0389  data: 0.0046  max mem: 281\n",
            "2021/05/21 22:16:16\tINFO\ttorchdistill.misc.log\tEpoch: [135]  [200/391]  eta: 0:00:08  lr: 0.010000000000000002  img/s: 3217.0497414356164  loss: 0.0461 (0.0306)  time: 0.0394  data: 0.0032  max mem: 281\n",
            "2021/05/21 22:16:20\tINFO\ttorchdistill.misc.log\tEpoch: [135]  [300/391]  eta: 0:00:04  lr: 0.010000000000000002  img/s: 4237.673944273423  loss: 0.0291 (0.0312)  time: 0.0397  data: 0.0043  max mem: 281\n",
            "2021/05/21 22:16:23\tINFO\ttorchdistill.misc.log\tEpoch: [135] Total time: 0:00:16\n",
            "2021/05/21 22:16:24\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:50  acc1: 92.9688 (92.9688)  acc5: 100.0000 (100.0000)  time: 0.6332  data: 0.5589  max mem: 281\n",
            "2021/05/21 22:16:26\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:16:26\tINFO\t__main__\t * Acc@1 91.4000\tAcc@5 99.7000\n",
            "\n",
            "2021/05/21 22:16:26\tINFO\ttorchdistill.misc.log\tEpoch: [136]  [  0/391]  eta: 0:05:46  lr: 0.0010000000000000002  img/s: 1180.5613786643034  loss: 0.0079 (0.0079)  time: 0.8854  data: 0.7770  max mem: 281\n",
            "2021/05/21 22:16:31\tINFO\ttorchdistill.misc.log\tEpoch: [136]  [100/391]  eta: 0:00:15  lr: 0.0010000000000000002  img/s: 4126.443349602245  loss: 0.0294 (0.0306)  time: 0.0373  data: 0.0063  max mem: 281\n",
            "2021/05/21 22:16:35\tINFO\ttorchdistill.misc.log\tEpoch: [136]  [200/391]  eta: 0:00:08  lr: 0.0010000000000000002  img/s: 3768.4407538693713  loss: 0.0218 (0.0290)  time: 0.0402  data: 0.0043  max mem: 281\n",
            "2021/05/21 22:16:39\tINFO\ttorchdistill.misc.log\tEpoch: [136]  [300/391]  eta: 0:00:03  lr: 0.0010000000000000002  img/s: 4643.97100496514  loss: 0.0145 (0.0278)  time: 0.0380  data: 0.0032  max mem: 281\n",
            "2021/05/21 22:16:42\tINFO\ttorchdistill.misc.log\tEpoch: [136] Total time: 0:00:16\n",
            "2021/05/21 22:16:43\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:45  acc1: 92.9688 (92.9688)  acc5: 100.0000 (100.0000)  time: 0.5720  data: 0.5333  max mem: 281\n",
            "2021/05/21 22:16:44\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:16:44\tINFO\t__main__\t * Acc@1 91.9200\tAcc@5 99.7000\n",
            "\n",
            "2021/05/21 22:16:45\tINFO\ttorchdistill.misc.log\tEpoch: [137]  [  0/391]  eta: 0:04:33  lr: 0.0010000000000000002  img/s: 1209.1142561145894  loss: 0.0040 (0.0040)  time: 0.6989  data: 0.5930  max mem: 281\n",
            "2021/05/21 22:16:50\tINFO\ttorchdistill.misc.log\tEpoch: [137]  [100/391]  eta: 0:00:15  lr: 0.0010000000000000002  img/s: 3349.7904286516505  loss: 0.0188 (0.0250)  time: 0.0390  data: 0.0038  max mem: 281\n",
            "2021/05/21 22:16:54\tINFO\ttorchdistill.misc.log\tEpoch: [137]  [200/391]  eta: 0:00:08  lr: 0.0010000000000000002  img/s: 3786.487467027774  loss: 0.0187 (0.0247)  time: 0.0393  data: 0.0048  max mem: 281\n",
            "2021/05/21 22:16:58\tINFO\ttorchdistill.misc.log\tEpoch: [137]  [300/391]  eta: 0:00:03  lr: 0.0010000000000000002  img/s: 3042.933889543847  loss: 0.0176 (0.0246)  time: 0.0401  data: 0.0051  max mem: 281\n",
            "2021/05/21 22:17:01\tINFO\ttorchdistill.misc.log\tEpoch: [137] Total time: 0:00:16\n",
            "2021/05/21 22:17:01\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:46  acc1: 92.9688 (92.9688)  acc5: 100.0000 (100.0000)  time: 0.5829  data: 0.5227  max mem: 281\n",
            "2021/05/21 22:17:03\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:17:03\tINFO\t__main__\t * Acc@1 91.9400\tAcc@5 99.7400\n",
            "\n",
            "2021/05/21 22:17:04\tINFO\ttorchdistill.misc.log\tEpoch: [138]  [  0/391]  eta: 0:06:18  lr: 0.0010000000000000002  img/s: 1044.1465346226555  loss: 0.0260 (0.0260)  time: 0.9680  data: 0.8454  max mem: 281\n",
            "2021/05/21 22:17:09\tINFO\ttorchdistill.misc.log\tEpoch: [138]  [100/391]  eta: 0:00:15  lr: 0.0010000000000000002  img/s: 4720.740305646906  loss: 0.0246 (0.0264)  time: 0.0395  data: 0.0030  max mem: 281\n",
            "2021/05/21 22:17:13\tINFO\ttorchdistill.misc.log\tEpoch: [138]  [200/391]  eta: 0:00:08  lr: 0.0010000000000000002  img/s: 5558.993466353272  loss: 0.0194 (0.0252)  time: 0.0388  data: 0.0039  max mem: 281\n",
            "2021/05/21 22:17:16\tINFO\ttorchdistill.misc.log\tEpoch: [138]  [300/391]  eta: 0:00:03  lr: 0.0010000000000000002  img/s: 5031.592427366448  loss: 0.0235 (0.0249)  time: 0.0385  data: 0.0059  max mem: 281\n",
            "2021/05/21 22:17:20\tINFO\ttorchdistill.misc.log\tEpoch: [138] Total time: 0:00:16\n",
            "2021/05/21 22:17:20\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:48  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.6119  data: 0.5641  max mem: 281\n",
            "2021/05/21 22:17:22\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:17:22\tINFO\t__main__\t * Acc@1 91.9300\tAcc@5 99.7300\n",
            "\n",
            "2021/05/21 22:17:23\tINFO\ttorchdistill.misc.log\tEpoch: [139]  [  0/391]  eta: 0:05:27  lr: 0.0010000000000000002  img/s: 1260.2751487693517  loss: 0.0094 (0.0094)  time: 0.8379  data: 0.7363  max mem: 281\n",
            "2021/05/21 22:17:28\tINFO\ttorchdistill.misc.log\tEpoch: [139]  [100/391]  eta: 0:00:15  lr: 0.0010000000000000002  img/s: 3934.1578145151834  loss: 0.0156 (0.0212)  time: 0.0399  data: 0.0052  max mem: 281\n",
            "2021/05/21 22:17:32\tINFO\ttorchdistill.misc.log\tEpoch: [139]  [200/391]  eta: 0:00:08  lr: 0.0010000000000000002  img/s: 4434.933806947255  loss: 0.0159 (0.0219)  time: 0.0395  data: 0.0045  max mem: 281\n",
            "2021/05/21 22:17:36\tINFO\ttorchdistill.misc.log\tEpoch: [139]  [300/391]  eta: 0:00:03  lr: 0.0010000000000000002  img/s: 3556.590628747077  loss: 0.0164 (0.0231)  time: 0.0400  data: 0.0043  max mem: 281\n",
            "2021/05/21 22:17:39\tINFO\ttorchdistill.misc.log\tEpoch: [139] Total time: 0:00:16\n",
            "2021/05/21 22:17:40\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:48  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.6165  data: 0.5887  max mem: 281\n",
            "2021/05/21 22:17:41\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:17:41\tINFO\t__main__\t * Acc@1 92.0000\tAcc@5 99.7400\n",
            "\n",
            "2021/05/21 22:17:42\tINFO\ttorchdistill.misc.log\tEpoch: [140]  [  0/391]  eta: 0:04:20  lr: 0.0010000000000000002  img/s: 1270.198316878299  loss: 0.0090 (0.0090)  time: 0.6671  data: 0.5663  max mem: 281\n",
            "2021/05/21 22:17:47\tINFO\ttorchdistill.misc.log\tEpoch: [140]  [100/391]  eta: 0:00:15  lr: 0.0010000000000000002  img/s: 3090.811760574327  loss: 0.0206 (0.0211)  time: 0.0402  data: 0.0042  max mem: 281\n",
            "2021/05/21 22:17:51\tINFO\ttorchdistill.misc.log\tEpoch: [140]  [200/391]  eta: 0:00:08  lr: 0.0010000000000000002  img/s: 3366.6583807308093  loss: 0.0138 (0.0214)  time: 0.0398  data: 0.0039  max mem: 281\n",
            "2021/05/21 22:17:55\tINFO\ttorchdistill.misc.log\tEpoch: [140]  [300/391]  eta: 0:00:03  lr: 0.0010000000000000002  img/s: 4001.542208905386  loss: 0.0254 (0.0225)  time: 0.0390  data: 0.0059  max mem: 281\n",
            "2021/05/21 22:17:58\tINFO\ttorchdistill.misc.log\tEpoch: [140] Total time: 0:00:16\n",
            "2021/05/21 22:17:58\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:43  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5548  data: 0.5216  max mem: 281\n",
            "2021/05/21 22:18:00\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:18:00\tINFO\t__main__\t * Acc@1 92.0000\tAcc@5 99.7400\n",
            "\n",
            "2021/05/21 22:18:01\tINFO\ttorchdistill.misc.log\tEpoch: [141]  [  0/391]  eta: 0:05:40  lr: 0.0010000000000000002  img/s: 1077.928498287348  loss: 0.0074 (0.0074)  time: 0.8701  data: 0.7513  max mem: 281\n",
            "2021/05/21 22:18:06\tINFO\ttorchdistill.misc.log\tEpoch: [141]  [100/391]  eta: 0:00:15  lr: 0.0010000000000000002  img/s: 3047.424744000182  loss: 0.0140 (0.0223)  time: 0.0382  data: 0.0040  max mem: 281\n",
            "2021/05/21 22:18:10\tINFO\ttorchdistill.misc.log\tEpoch: [141]  [200/391]  eta: 0:00:08  lr: 0.0010000000000000002  img/s: 4599.726794496136  loss: 0.0175 (0.0225)  time: 0.0406  data: 0.0043  max mem: 281\n",
            "2021/05/21 22:18:13\tINFO\ttorchdistill.misc.log\tEpoch: [141]  [300/391]  eta: 0:00:03  lr: 0.0010000000000000002  img/s: 3065.696554402074  loss: 0.0199 (0.0231)  time: 0.0395  data: 0.0036  max mem: 281\n",
            "2021/05/21 22:18:17\tINFO\ttorchdistill.misc.log\tEpoch: [141] Total time: 0:00:16\n",
            "2021/05/21 22:18:17\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:46  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5831  data: 0.5418  max mem: 281\n",
            "2021/05/21 22:18:19\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:18:19\tINFO\t__main__\t * Acc@1 92.0000\tAcc@5 99.7100\n",
            "\n",
            "2021/05/21 22:18:20\tINFO\ttorchdistill.misc.log\tEpoch: [142]  [  0/391]  eta: 0:05:40  lr: 0.0010000000000000002  img/s: 1179.2958811370531  loss: 0.0116 (0.0116)  time: 0.8702  data: 0.7616  max mem: 281\n",
            "2021/05/21 22:18:25\tINFO\ttorchdistill.misc.log\tEpoch: [142]  [100/391]  eta: 0:00:15  lr: 0.0010000000000000002  img/s: 3848.592180533054  loss: 0.0151 (0.0215)  time: 0.0390  data: 0.0054  max mem: 281\n",
            "2021/05/21 22:18:29\tINFO\ttorchdistill.misc.log\tEpoch: [142]  [200/391]  eta: 0:00:08  lr: 0.0010000000000000002  img/s: 3424.2492075134737  loss: 0.0157 (0.0223)  time: 0.0391  data: 0.0032  max mem: 281\n",
            "2021/05/21 22:18:33\tINFO\ttorchdistill.misc.log\tEpoch: [142]  [300/391]  eta: 0:00:04  lr: 0.0010000000000000002  img/s: 3047.8918618183884  loss: 0.0246 (0.0227)  time: 0.0404  data: 0.0044  max mem: 281\n",
            "2021/05/21 22:18:36\tINFO\ttorchdistill.misc.log\tEpoch: [142] Total time: 0:00:16\n",
            "2021/05/21 22:18:37\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:47  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.6037  data: 0.5539  max mem: 281\n",
            "2021/05/21 22:18:38\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:18:38\tINFO\t__main__\t * Acc@1 91.9900\tAcc@5 99.7300\n",
            "\n",
            "2021/05/21 22:18:39\tINFO\ttorchdistill.misc.log\tEpoch: [143]  [  0/391]  eta: 0:04:41  lr: 0.0010000000000000002  img/s: 1108.1155689487914  loss: 0.0206 (0.0206)  time: 0.7193  data: 0.6038  max mem: 281\n",
            "2021/05/21 22:18:44\tINFO\ttorchdistill.misc.log\tEpoch: [143]  [100/391]  eta: 0:00:15  lr: 0.0010000000000000002  img/s: 4611.8572299868565  loss: 0.0199 (0.0211)  time: 0.0389  data: 0.0047  max mem: 281\n",
            "2021/05/21 22:18:48\tINFO\ttorchdistill.misc.log\tEpoch: [143]  [200/391]  eta: 0:00:08  lr: 0.0010000000000000002  img/s: 2224.956638140036  loss: 0.0171 (0.0217)  time: 0.0401  data: 0.0036  max mem: 281\n",
            "2021/05/21 22:18:52\tINFO\ttorchdistill.misc.log\tEpoch: [143]  [300/391]  eta: 0:00:03  lr: 0.0010000000000000002  img/s: 3925.126204506573  loss: 0.0180 (0.0220)  time: 0.0410  data: 0.0055  max mem: 281\n",
            "2021/05/21 22:18:55\tINFO\ttorchdistill.misc.log\tEpoch: [143] Total time: 0:00:16\n",
            "2021/05/21 22:18:56\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:43  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5559  data: 0.5344  max mem: 281\n",
            "2021/05/21 22:18:57\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:18:57\tINFO\t__main__\t * Acc@1 91.9400\tAcc@5 99.7400\n",
            "\n",
            "2021/05/21 22:18:58\tINFO\ttorchdistill.misc.log\tEpoch: [144]  [  0/391]  eta: 0:06:20  lr: 0.0010000000000000002  img/s: 1042.0125420932602  loss: 0.0182 (0.0182)  time: 0.9725  data: 0.8496  max mem: 281\n",
            "2021/05/21 22:19:03\tINFO\ttorchdistill.misc.log\tEpoch: [144]  [100/391]  eta: 0:00:15  lr: 0.0010000000000000002  img/s: 3927.4233127039165  loss: 0.0161 (0.0217)  time: 0.0382  data: 0.0029  max mem: 281\n",
            "2021/05/21 22:19:07\tINFO\ttorchdistill.misc.log\tEpoch: [144]  [200/391]  eta: 0:00:08  lr: 0.0010000000000000002  img/s: 3429.630392426169  loss: 0.0164 (0.0215)  time: 0.0396  data: 0.0029  max mem: 281\n",
            "2021/05/21 22:19:11\tINFO\ttorchdistill.misc.log\tEpoch: [144]  [300/391]  eta: 0:00:03  lr: 0.0010000000000000002  img/s: 4304.022960308489  loss: 0.0220 (0.0218)  time: 0.0403  data: 0.0042  max mem: 281\n",
            "2021/05/21 22:19:14\tINFO\ttorchdistill.misc.log\tEpoch: [144] Total time: 0:00:16\n",
            "2021/05/21 22:19:15\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:46  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5864  data: 0.5523  max mem: 281\n",
            "2021/05/21 22:19:16\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:19:16\tINFO\t__main__\t * Acc@1 92.0200\tAcc@5 99.6800\n",
            "\n",
            "2021/05/21 22:19:17\tINFO\ttorchdistill.misc.log\tEpoch: [145]  [  0/391]  eta: 0:06:18  lr: 0.0010000000000000002  img/s: 1158.7925629503002  loss: 0.0477 (0.0477)  time: 0.9673  data: 0.8568  max mem: 281\n",
            "2021/05/21 22:19:22\tINFO\ttorchdistill.misc.log\tEpoch: [145]  [100/391]  eta: 0:00:15  lr: 0.0010000000000000002  img/s: 3824.6841347866352  loss: 0.0152 (0.0194)  time: 0.0391  data: 0.0046  max mem: 281\n",
            "2021/05/21 22:19:26\tINFO\ttorchdistill.misc.log\tEpoch: [145]  [200/391]  eta: 0:00:08  lr: 0.0010000000000000002  img/s: 3461.8518719129233  loss: 0.0152 (0.0205)  time: 0.0389  data: 0.0052  max mem: 281\n",
            "2021/05/21 22:19:30\tINFO\ttorchdistill.misc.log\tEpoch: [145]  [300/391]  eta: 0:00:03  lr: 0.0010000000000000002  img/s: 3759.9161834327815  loss: 0.0191 (0.0210)  time: 0.0402  data: 0.0039  max mem: 281\n",
            "2021/05/21 22:19:33\tINFO\ttorchdistill.misc.log\tEpoch: [145] Total time: 0:00:16\n",
            "2021/05/21 22:19:34\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:42  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5426  data: 0.5141  max mem: 281\n",
            "2021/05/21 22:19:35\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:19:35\tINFO\t__main__\t * Acc@1 91.9300\tAcc@5 99.7400\n",
            "\n",
            "2021/05/21 22:19:36\tINFO\ttorchdistill.misc.log\tEpoch: [146]  [  0/391]  eta: 0:04:16  lr: 0.0010000000000000002  img/s: 1060.9950297130276  loss: 0.0256 (0.0256)  time: 0.6551  data: 0.5344  max mem: 281\n",
            "2021/05/21 22:19:41\tINFO\ttorchdistill.misc.log\tEpoch: [146]  [100/391]  eta: 0:00:15  lr: 0.0010000000000000002  img/s: 4247.698902611736  loss: 0.0146 (0.0191)  time: 0.0389  data: 0.0048  max mem: 281\n",
            "2021/05/21 22:19:45\tINFO\ttorchdistill.misc.log\tEpoch: [146]  [200/391]  eta: 0:00:08  lr: 0.0010000000000000002  img/s: 4156.956345334882  loss: 0.0191 (0.0205)  time: 0.0394  data: 0.0048  max mem: 281\n",
            "2021/05/21 22:19:49\tINFO\ttorchdistill.misc.log\tEpoch: [146]  [300/391]  eta: 0:00:03  lr: 0.0010000000000000002  img/s: 3096.4806524359647  loss: 0.0199 (0.0215)  time: 0.0393  data: 0.0044  max mem: 281\n",
            "2021/05/21 22:19:52\tINFO\ttorchdistill.misc.log\tEpoch: [146] Total time: 0:00:16\n",
            "2021/05/21 22:19:53\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5643  data: 0.5354  max mem: 281\n",
            "2021/05/21 22:19:54\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:19:54\tINFO\t__main__\t * Acc@1 92.0000\tAcc@5 99.7300\n",
            "\n",
            "2021/05/21 22:19:55\tINFO\ttorchdistill.misc.log\tEpoch: [147]  [  0/391]  eta: 0:05:19  lr: 0.0010000000000000002  img/s: 1255.873643236769  loss: 0.0206 (0.0206)  time: 0.8172  data: 0.7152  max mem: 281\n",
            "2021/05/21 22:20:00\tINFO\ttorchdistill.misc.log\tEpoch: [147]  [100/391]  eta: 0:00:15  lr: 0.0010000000000000002  img/s: 3406.1090724527344  loss: 0.0164 (0.0207)  time: 0.0402  data: 0.0057  max mem: 281\n",
            "2021/05/21 22:20:04\tINFO\ttorchdistill.misc.log\tEpoch: [147]  [200/391]  eta: 0:00:08  lr: 0.0010000000000000002  img/s: 3839.86633766048  loss: 0.0193 (0.0211)  time: 0.0394  data: 0.0032  max mem: 281\n",
            "2021/05/21 22:20:08\tINFO\ttorchdistill.misc.log\tEpoch: [147]  [300/391]  eta: 0:00:03  lr: 0.0010000000000000002  img/s: 3199.7169744974285  loss: 0.0149 (0.0207)  time: 0.0390  data: 0.0030  max mem: 281\n",
            "2021/05/21 22:20:11\tINFO\ttorchdistill.misc.log\tEpoch: [147] Total time: 0:00:16\n",
            "2021/05/21 22:20:12\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5677  data: 0.5362  max mem: 281\n",
            "2021/05/21 22:20:13\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:20:13\tINFO\t__main__\t * Acc@1 92.0200\tAcc@5 99.7600\n",
            "\n",
            "2021/05/21 22:20:14\tINFO\ttorchdistill.misc.log\tEpoch: [148]  [  0/391]  eta: 0:04:36  lr: 0.0010000000000000002  img/s: 982.1665767197993  loss: 0.0117 (0.0117)  time: 0.7075  data: 0.5772  max mem: 281\n",
            "2021/05/21 22:20:19\tINFO\ttorchdistill.misc.log\tEpoch: [148]  [100/391]  eta: 0:00:15  lr: 0.0010000000000000002  img/s: 3908.5237370685577  loss: 0.0158 (0.0197)  time: 0.0400  data: 0.0056  max mem: 281\n",
            "2021/05/21 22:20:23\tINFO\ttorchdistill.misc.log\tEpoch: [148]  [200/391]  eta: 0:00:08  lr: 0.0010000000000000002  img/s: 5084.293728810349  loss: 0.0238 (0.0203)  time: 0.0373  data: 0.0047  max mem: 281\n",
            "2021/05/21 22:20:27\tINFO\ttorchdistill.misc.log\tEpoch: [148]  [300/391]  eta: 0:00:03  lr: 0.0010000000000000002  img/s: 4050.6025456273906  loss: 0.0221 (0.0209)  time: 0.0395  data: 0.0047  max mem: 281\n",
            "2021/05/21 22:20:30\tINFO\ttorchdistill.misc.log\tEpoch: [148] Total time: 0:00:16\n",
            "2021/05/21 22:20:31\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:43  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5474  data: 0.5280  max mem: 281\n",
            "2021/05/21 22:20:33\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:20:33\tINFO\t__main__\t * Acc@1 92.0100\tAcc@5 99.7100\n",
            "\n",
            "2021/05/21 22:20:33\tINFO\ttorchdistill.misc.log\tEpoch: [149]  [  0/391]  eta: 0:05:20  lr: 0.0010000000000000002  img/s: 1148.667080314772  loss: 0.0069 (0.0069)  time: 0.8198  data: 0.7083  max mem: 281\n",
            "2021/05/21 22:20:38\tINFO\ttorchdistill.misc.log\tEpoch: [149]  [100/391]  eta: 0:00:15  lr: 0.0010000000000000002  img/s: 3552.9188720575485  loss: 0.0184 (0.0205)  time: 0.0397  data: 0.0058  max mem: 281\n",
            "2021/05/21 22:20:42\tINFO\ttorchdistill.misc.log\tEpoch: [149]  [200/391]  eta: 0:00:08  lr: 0.0010000000000000002  img/s: 3460.401503090617  loss: 0.0148 (0.0200)  time: 0.0400  data: 0.0039  max mem: 281\n",
            "2021/05/21 22:20:46\tINFO\ttorchdistill.misc.log\tEpoch: [149]  [300/391]  eta: 0:00:03  lr: 0.0010000000000000002  img/s: 3301.4845616948005  loss: 0.0174 (0.0205)  time: 0.0381  data: 0.0045  max mem: 281\n",
            "2021/05/21 22:20:49\tINFO\ttorchdistill.misc.log\tEpoch: [149] Total time: 0:00:16\n",
            "2021/05/21 22:20:50\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:47  acc1: 92.9688 (92.9688)  acc5: 100.0000 (100.0000)  time: 0.5980  data: 0.5654  max mem: 281\n",
            "2021/05/21 22:20:52\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:20:52\tINFO\t__main__\t * Acc@1 91.9400\tAcc@5 99.7500\n",
            "\n",
            "2021/05/21 22:20:52\tINFO\ttorchdistill.misc.log\tEpoch: [150]  [  0/391]  eta: 0:04:36  lr: 0.0010000000000000002  img/s: 1196.665720100125  loss: 0.0353 (0.0353)  time: 0.7070  data: 0.6000  max mem: 281\n",
            "2021/05/21 22:20:57\tINFO\ttorchdistill.misc.log\tEpoch: [150]  [100/391]  eta: 0:00:15  lr: 0.0010000000000000002  img/s: 3195.6601904761906  loss: 0.0166 (0.0199)  time: 0.0400  data: 0.0028  max mem: 281\n",
            "2021/05/21 22:21:01\tINFO\ttorchdistill.misc.log\tEpoch: [150]  [200/391]  eta: 0:00:08  lr: 0.0010000000000000002  img/s: 4348.999262841543  loss: 0.0163 (0.0198)  time: 0.0386  data: 0.0039  max mem: 281\n",
            "2021/05/21 22:21:05\tINFO\ttorchdistill.misc.log\tEpoch: [150]  [300/391]  eta: 0:00:04  lr: 0.0010000000000000002  img/s: 5192.677357578103  loss: 0.0140 (0.0197)  time: 0.0399  data: 0.0052  max mem: 281\n",
            "2021/05/21 22:21:08\tINFO\ttorchdistill.misc.log\tEpoch: [150] Total time: 0:00:16\n",
            "2021/05/21 22:21:09\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5619  data: 0.5316  max mem: 281\n",
            "2021/05/21 22:21:11\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:21:11\tINFO\t__main__\t * Acc@1 91.9600\tAcc@5 99.7300\n",
            "\n",
            "2021/05/21 22:21:12\tINFO\ttorchdistill.misc.log\tEpoch: [151]  [  0/391]  eta: 0:05:46  lr: 0.0010000000000000002  img/s: 1270.2884792386847  loss: 0.0119 (0.0119)  time: 0.8861  data: 0.7853  max mem: 281\n",
            "2021/05/21 22:21:16\tINFO\ttorchdistill.misc.log\tEpoch: [151]  [100/391]  eta: 0:00:15  lr: 0.0010000000000000002  img/s: 3500.517783906787  loss: 0.0170 (0.0190)  time: 0.0393  data: 0.0047  max mem: 281\n",
            "2021/05/21 22:21:20\tINFO\ttorchdistill.misc.log\tEpoch: [151]  [200/391]  eta: 0:00:08  lr: 0.0010000000000000002  img/s: 4646.462923215398  loss: 0.0146 (0.0200)  time: 0.0384  data: 0.0042  max mem: 281\n",
            "2021/05/21 22:21:24\tINFO\ttorchdistill.misc.log\tEpoch: [151]  [300/391]  eta: 0:00:04  lr: 0.0010000000000000002  img/s: 3699.6238293767015  loss: 0.0185 (0.0201)  time: 0.0405  data: 0.0060  max mem: 281\n",
            "2021/05/21 22:21:27\tINFO\ttorchdistill.misc.log\tEpoch: [151] Total time: 0:00:16\n",
            "2021/05/21 22:21:28\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:50  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.6375  data: 0.6128  max mem: 281\n",
            "2021/05/21 22:21:30\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:21:30\tINFO\t__main__\t * Acc@1 91.9200\tAcc@5 99.7400\n",
            "\n",
            "2021/05/21 22:21:30\tINFO\ttorchdistill.misc.log\tEpoch: [152]  [  0/391]  eta: 0:04:20  lr: 0.0010000000000000002  img/s: 994.5774382268922  loss: 0.0150 (0.0150)  time: 0.6666  data: 0.5378  max mem: 281\n",
            "2021/05/21 22:21:35\tINFO\ttorchdistill.misc.log\tEpoch: [152]  [100/391]  eta: 0:00:15  lr: 0.0010000000000000002  img/s: 2845.5100199816616  loss: 0.0170 (0.0213)  time: 0.0408  data: 0.0036  max mem: 281\n",
            "2021/05/21 22:21:39\tINFO\ttorchdistill.misc.log\tEpoch: [152]  [200/391]  eta: 0:00:08  lr: 0.0010000000000000002  img/s: 3015.874572367497  loss: 0.0131 (0.0211)  time: 0.0392  data: 0.0050  max mem: 281\n",
            "2021/05/21 22:21:43\tINFO\ttorchdistill.misc.log\tEpoch: [152]  [300/391]  eta: 0:00:04  lr: 0.0010000000000000002  img/s: 2333.257619678828  loss: 0.0129 (0.0202)  time: 0.0410  data: 0.0050  max mem: 281\n",
            "2021/05/21 22:21:46\tINFO\ttorchdistill.misc.log\tEpoch: [152] Total time: 0:00:16\n",
            "2021/05/21 22:21:47\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:48  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.6160  data: 0.5941  max mem: 281\n",
            "2021/05/21 22:21:49\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:21:49\tINFO\t__main__\t * Acc@1 91.9500\tAcc@5 99.7700\n",
            "\n",
            "2021/05/21 22:21:50\tINFO\ttorchdistill.misc.log\tEpoch: [153]  [  0/391]  eta: 0:04:21  lr: 0.0010000000000000002  img/s: 961.3744549558503  loss: 0.0201 (0.0201)  time: 0.6675  data: 0.5344  max mem: 281\n",
            "2021/05/21 22:21:54\tINFO\ttorchdistill.misc.log\tEpoch: [153]  [100/391]  eta: 0:00:15  lr: 0.0010000000000000002  img/s: 3271.5284941256764  loss: 0.0161 (0.0195)  time: 0.0394  data: 0.0039  max mem: 281\n",
            "2021/05/21 22:21:58\tINFO\ttorchdistill.misc.log\tEpoch: [153]  [200/391]  eta: 0:00:08  lr: 0.0010000000000000002  img/s: 2909.207183188651  loss: 0.0179 (0.0202)  time: 0.0419  data: 0.0052  max mem: 281\n",
            "2021/05/21 22:22:02\tINFO\ttorchdistill.misc.log\tEpoch: [153]  [300/391]  eta: 0:00:03  lr: 0.0010000000000000002  img/s: 3223.6754653536686  loss: 0.0145 (0.0201)  time: 0.0404  data: 0.0047  max mem: 281\n",
            "2021/05/21 22:22:05\tINFO\ttorchdistill.misc.log\tEpoch: [153] Total time: 0:00:16\n",
            "2021/05/21 22:22:06\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 92.9688 (92.9688)  acc5: 100.0000 (100.0000)  time: 0.5613  data: 0.5205  max mem: 281\n",
            "2021/05/21 22:22:08\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:22:08\tINFO\t__main__\t * Acc@1 91.8300\tAcc@5 99.7500\n",
            "\n",
            "2021/05/21 22:22:09\tINFO\ttorchdistill.misc.log\tEpoch: [154]  [  0/391]  eta: 0:04:42  lr: 0.0010000000000000002  img/s: 887.7655867606788  loss: 0.0059 (0.0059)  time: 0.7224  data: 0.5782  max mem: 281\n",
            "2021/05/21 22:22:13\tINFO\ttorchdistill.misc.log\tEpoch: [154]  [100/391]  eta: 0:00:15  lr: 0.0010000000000000002  img/s: 2851.3434915846556  loss: 0.0242 (0.0209)  time: 0.0386  data: 0.0048  max mem: 281\n",
            "2021/05/21 22:22:17\tINFO\ttorchdistill.misc.log\tEpoch: [154]  [200/391]  eta: 0:00:08  lr: 0.0010000000000000002  img/s: 3955.0541243379034  loss: 0.0167 (0.0195)  time: 0.0393  data: 0.0031  max mem: 281\n",
            "2021/05/21 22:22:21\tINFO\ttorchdistill.misc.log\tEpoch: [154]  [300/391]  eta: 0:00:04  lr: 0.0010000000000000002  img/s: 3749.884137738353  loss: 0.0240 (0.0200)  time: 0.0389  data: 0.0046  max mem: 281\n",
            "2021/05/21 22:22:25\tINFO\ttorchdistill.misc.log\tEpoch: [154] Total time: 0:00:16\n",
            "2021/05/21 22:22:25\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:47  acc1: 92.9688 (92.9688)  acc5: 100.0000 (100.0000)  time: 0.5959  data: 0.5623  max mem: 281\n",
            "2021/05/21 22:22:27\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:22:27\tINFO\t__main__\t * Acc@1 91.9300\tAcc@5 99.7600\n",
            "\n",
            "2021/05/21 22:22:28\tINFO\ttorchdistill.misc.log\tEpoch: [155]  [  0/391]  eta: 0:04:47  lr: 0.0010000000000000002  img/s: 1058.299123194348  loss: 0.0156 (0.0156)  time: 0.7364  data: 0.6154  max mem: 281\n",
            "2021/05/21 22:22:32\tINFO\ttorchdistill.misc.log\tEpoch: [155]  [100/391]  eta: 0:00:15  lr: 0.0010000000000000002  img/s: 4026.3305234738264  loss: 0.0256 (0.0212)  time: 0.0407  data: 0.0054  max mem: 281\n",
            "2021/05/21 22:22:36\tINFO\ttorchdistill.misc.log\tEpoch: [155]  [200/391]  eta: 0:00:08  lr: 0.0010000000000000002  img/s: 2262.0901851399294  loss: 0.0160 (0.0198)  time: 0.0421  data: 0.0037  max mem: 281\n",
            "2021/05/21 22:22:40\tINFO\ttorchdistill.misc.log\tEpoch: [155]  [300/391]  eta: 0:00:04  lr: 0.0010000000000000002  img/s: 4921.493046834178  loss: 0.0180 (0.0198)  time: 0.0385  data: 0.0046  max mem: 281\n",
            "2021/05/21 22:22:44\tINFO\ttorchdistill.misc.log\tEpoch: [155] Total time: 0:00:16\n",
            "2021/05/21 22:22:44\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:48  acc1: 92.9688 (92.9688)  acc5: 100.0000 (100.0000)  time: 0.6095  data: 0.5802  max mem: 281\n",
            "2021/05/21 22:22:46\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:22:46\tINFO\t__main__\t * Acc@1 91.9700\tAcc@5 99.7500\n",
            "\n",
            "2021/05/21 22:22:47\tINFO\ttorchdistill.misc.log\tEpoch: [156]  [  0/391]  eta: 0:04:08  lr: 0.0010000000000000002  img/s: 1254.0724219928895  loss: 0.0111 (0.0111)  time: 0.6346  data: 0.5325  max mem: 281\n",
            "2021/05/21 22:22:52\tINFO\ttorchdistill.misc.log\tEpoch: [156]  [100/391]  eta: 0:00:15  lr: 0.0010000000000000002  img/s: 4925.9183220324985  loss: 0.0209 (0.0206)  time: 0.0387  data: 0.0045  max mem: 281\n",
            "2021/05/21 22:22:56\tINFO\ttorchdistill.misc.log\tEpoch: [156]  [200/391]  eta: 0:00:08  lr: 0.0010000000000000002  img/s: 2481.699018175767  loss: 0.0190 (0.0204)  time: 0.0393  data: 0.0042  max mem: 281\n",
            "2021/05/21 22:23:00\tINFO\ttorchdistill.misc.log\tEpoch: [156]  [300/391]  eta: 0:00:04  lr: 0.0010000000000000002  img/s: 4040.147135847807  loss: 0.0165 (0.0203)  time: 0.0397  data: 0.0052  max mem: 281\n",
            "2021/05/21 22:23:03\tINFO\ttorchdistill.misc.log\tEpoch: [156] Total time: 0:00:16\n",
            "2021/05/21 22:23:04\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:48  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.6100  data: 0.5450  max mem: 281\n",
            "2021/05/21 22:23:06\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:23:06\tINFO\t__main__\t * Acc@1 91.8600\tAcc@5 99.7400\n",
            "\n",
            "2021/05/21 22:23:06\tINFO\ttorchdistill.misc.log\tEpoch: [157]  [  0/391]  eta: 0:04:21  lr: 0.0010000000000000002  img/s: 944.9224378876521  loss: 0.0315 (0.0315)  time: 0.6698  data: 0.5343  max mem: 281\n",
            "2021/05/21 22:23:11\tINFO\ttorchdistill.misc.log\tEpoch: [157]  [100/391]  eta: 0:00:15  lr: 0.0010000000000000002  img/s: 5409.769268749811  loss: 0.0166 (0.0194)  time: 0.0405  data: 0.0050  max mem: 281\n",
            "2021/05/21 22:23:15\tINFO\ttorchdistill.misc.log\tEpoch: [157]  [200/391]  eta: 0:00:08  lr: 0.0010000000000000002  img/s: 3248.5457416875925  loss: 0.0145 (0.0195)  time: 0.0397  data: 0.0047  max mem: 281\n",
            "2021/05/21 22:23:19\tINFO\ttorchdistill.misc.log\tEpoch: [157]  [300/391]  eta: 0:00:04  lr: 0.0010000000000000002  img/s: 3575.801998135074  loss: 0.0170 (0.0195)  time: 0.0409  data: 0.0037  max mem: 281\n",
            "2021/05/21 22:23:23\tINFO\ttorchdistill.misc.log\tEpoch: [157] Total time: 0:00:17\n",
            "2021/05/21 22:23:23\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:56  acc1: 92.9688 (92.9688)  acc5: 100.0000 (100.0000)  time: 0.7195  data: 0.6909  max mem: 281\n",
            "2021/05/21 22:23:25\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:23:25\tINFO\t__main__\t * Acc@1 91.8600\tAcc@5 99.7400\n",
            "\n",
            "2021/05/21 22:23:26\tINFO\ttorchdistill.misc.log\tEpoch: [158]  [  0/391]  eta: 0:06:14  lr: 0.0010000000000000002  img/s: 825.9959136449794  loss: 0.0275 (0.0275)  time: 0.9572  data: 0.8022  max mem: 281\n",
            "2021/05/21 22:23:30\tINFO\ttorchdistill.misc.log\tEpoch: [158]  [100/391]  eta: 0:00:15  lr: 0.0010000000000000002  img/s: 4145.465237668715  loss: 0.0147 (0.0175)  time: 0.0392  data: 0.0055  max mem: 281\n",
            "2021/05/21 22:23:34\tINFO\ttorchdistill.misc.log\tEpoch: [158]  [200/391]  eta: 0:00:08  lr: 0.0010000000000000002  img/s: 3711.9530950751214  loss: 0.0227 (0.0192)  time: 0.0389  data: 0.0053  max mem: 281\n",
            "2021/05/21 22:23:39\tINFO\ttorchdistill.misc.log\tEpoch: [158]  [300/391]  eta: 0:00:04  lr: 0.0010000000000000002  img/s: 1775.9129361873856  loss: 0.0170 (0.0202)  time: 0.0445  data: 0.0065  max mem: 281\n",
            "2021/05/21 22:23:42\tINFO\ttorchdistill.misc.log\tEpoch: [158] Total time: 0:00:17\n",
            "2021/05/21 22:23:43\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:47  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.6057  data: 0.5534  max mem: 281\n",
            "2021/05/21 22:23:45\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:23:45\tINFO\t__main__\t * Acc@1 92.0800\tAcc@5 99.7200\n",
            "\n",
            "2021/05/21 22:23:45\tINFO\t__main__\tUpdating ckpt (Best top1 accuracy: 92.0400 -> 92.0800)\n",
            "2021/05/21 22:23:46\tINFO\ttorchdistill.misc.log\tEpoch: [159]  [  0/391]  eta: 0:07:03  lr: 0.0010000000000000002  img/s: 933.402840174138  loss: 0.0227 (0.0227)  time: 1.0831  data: 0.9460  max mem: 281\n",
            "2021/05/21 22:23:51\tINFO\ttorchdistill.misc.log\tEpoch: [159]  [100/391]  eta: 0:00:16  lr: 0.0010000000000000002  img/s: 3280.103326714526  loss: 0.0221 (0.0206)  time: 0.0427  data: 0.0058  max mem: 281\n",
            "2021/05/21 22:23:55\tINFO\ttorchdistill.misc.log\tEpoch: [159]  [200/391]  eta: 0:00:09  lr: 0.0010000000000000002  img/s: 2790.9695986691618  loss: 0.0217 (0.0206)  time: 0.0432  data: 0.0033  max mem: 281\n",
            "2021/05/21 22:23:59\tINFO\ttorchdistill.misc.log\tEpoch: [159]  [300/391]  eta: 0:00:04  lr: 0.0010000000000000002  img/s: 3872.6613239463036  loss: 0.0140 (0.0205)  time: 0.0414  data: 0.0059  max mem: 281\n",
            "2021/05/21 22:24:03\tINFO\ttorchdistill.misc.log\tEpoch: [159] Total time: 0:00:17\n",
            "2021/05/21 22:24:03\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:50  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.6360  data: 0.5921  max mem: 281\n",
            "2021/05/21 22:24:05\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:24:05\tINFO\t__main__\t * Acc@1 92.0100\tAcc@5 99.7200\n",
            "\n",
            "2021/05/21 22:24:06\tINFO\ttorchdistill.misc.log\tEpoch: [160]  [  0/391]  eta: 0:05:57  lr: 0.0010000000000000002  img/s: 899.5027452320755  loss: 0.0277 (0.0277)  time: 0.9139  data: 0.7716  max mem: 281\n",
            "2021/05/21 22:24:11\tINFO\ttorchdistill.misc.log\tEpoch: [160]  [100/391]  eta: 0:00:16  lr: 0.0010000000000000002  img/s: 4778.599827323786  loss: 0.0122 (0.0179)  time: 0.0422  data: 0.0036  max mem: 281\n",
            "2021/05/21 22:24:15\tINFO\ttorchdistill.misc.log\tEpoch: [160]  [200/391]  eta: 0:00:09  lr: 0.0010000000000000002  img/s: 4292.769398068189  loss: 0.0160 (0.0183)  time: 0.0420  data: 0.0062  max mem: 281\n",
            "2021/05/21 22:24:20\tINFO\ttorchdistill.misc.log\tEpoch: [160]  [300/391]  eta: 0:00:04  lr: 0.0010000000000000002  img/s: 3691.153621912986  loss: 0.0177 (0.0186)  time: 0.0413  data: 0.0059  max mem: 281\n",
            "2021/05/21 22:24:23\tINFO\ttorchdistill.misc.log\tEpoch: [160] Total time: 0:00:17\n",
            "2021/05/21 22:24:24\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:47  acc1: 92.9688 (92.9688)  acc5: 100.0000 (100.0000)  time: 0.5988  data: 0.5870  max mem: 281\n",
            "2021/05/21 22:24:26\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:24:26\tINFO\t__main__\t * Acc@1 91.9000\tAcc@5 99.7900\n",
            "\n",
            "2021/05/21 22:24:26\tINFO\ttorchdistill.misc.log\tEpoch: [161]  [  0/391]  eta: 0:04:23  lr: 0.0010000000000000002  img/s: 930.0604979185542  loss: 0.0551 (0.0551)  time: 0.6743  data: 0.5366  max mem: 281\n",
            "2021/05/21 22:24:31\tINFO\ttorchdistill.misc.log\tEpoch: [161]  [100/391]  eta: 0:00:15  lr: 0.0010000000000000002  img/s: 3658.953383130691  loss: 0.0211 (0.0202)  time: 0.0413  data: 0.0043  max mem: 281\n",
            "2021/05/21 22:24:35\tINFO\ttorchdistill.misc.log\tEpoch: [161]  [200/391]  eta: 0:00:09  lr: 0.0010000000000000002  img/s: 3587.797965757361  loss: 0.0137 (0.0193)  time: 0.0394  data: 0.0040  max mem: 281\n",
            "2021/05/21 22:24:39\tINFO\ttorchdistill.misc.log\tEpoch: [161]  [300/391]  eta: 0:00:04  lr: 0.0010000000000000002  img/s: 2954.2715831989744  loss: 0.0148 (0.0185)  time: 0.0395  data: 0.0038  max mem: 281\n",
            "2021/05/21 22:24:43\tINFO\ttorchdistill.misc.log\tEpoch: [161] Total time: 0:00:17\n",
            "2021/05/21 22:24:43\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:45  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5745  data: 0.5458  max mem: 281\n",
            "2021/05/21 22:24:45\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:24:45\tINFO\t__main__\t * Acc@1 92.0200\tAcc@5 99.7500\n",
            "\n",
            "2021/05/21 22:24:46\tINFO\ttorchdistill.misc.log\tEpoch: [162]  [  0/391]  eta: 0:05:21  lr: 0.0010000000000000002  img/s: 1113.5074002787549  loss: 0.0162 (0.0162)  time: 0.8229  data: 0.7079  max mem: 281\n",
            "2021/05/21 22:24:51\tINFO\ttorchdistill.misc.log\tEpoch: [162]  [100/391]  eta: 0:00:15  lr: 0.0010000000000000002  img/s: 3470.0637430113434  loss: 0.0146 (0.0198)  time: 0.0385  data: 0.0042  max mem: 281\n",
            "2021/05/21 22:24:55\tINFO\ttorchdistill.misc.log\tEpoch: [162]  [200/391]  eta: 0:00:08  lr: 0.0010000000000000002  img/s: 3464.4208896087553  loss: 0.0194 (0.0190)  time: 0.0410  data: 0.0073  max mem: 281\n",
            "2021/05/21 22:24:59\tINFO\ttorchdistill.misc.log\tEpoch: [162]  [300/391]  eta: 0:00:04  lr: 0.0010000000000000002  img/s: 3998.8597306638067  loss: 0.0125 (0.0194)  time: 0.0397  data: 0.0053  max mem: 281\n",
            "2021/05/21 22:25:02\tINFO\ttorchdistill.misc.log\tEpoch: [162] Total time: 0:00:16\n",
            "2021/05/21 22:25:03\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:42  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5423  data: 0.5086  max mem: 281\n",
            "2021/05/21 22:25:05\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:25:05\tINFO\t__main__\t * Acc@1 91.8600\tAcc@5 99.7000\n",
            "\n",
            "2021/05/21 22:25:05\tINFO\ttorchdistill.misc.log\tEpoch: [163]  [  0/391]  eta: 0:04:42  lr: 0.0010000000000000002  img/s: 1069.1104375843845  loss: 0.0232 (0.0232)  time: 0.7231  data: 0.6033  max mem: 281\n",
            "2021/05/21 22:25:10\tINFO\ttorchdistill.misc.log\tEpoch: [163]  [100/391]  eta: 0:00:15  lr: 0.0010000000000000002  img/s: 5516.60941851026  loss: 0.0196 (0.0185)  time: 0.0412  data: 0.0068  max mem: 281\n",
            "2021/05/21 22:25:14\tINFO\ttorchdistill.misc.log\tEpoch: [163]  [200/391]  eta: 0:00:09  lr: 0.0010000000000000002  img/s: 3553.9066759342004  loss: 0.0182 (0.0183)  time: 0.0406  data: 0.0035  max mem: 281\n",
            "2021/05/21 22:25:18\tINFO\ttorchdistill.misc.log\tEpoch: [163]  [300/391]  eta: 0:00:04  lr: 0.0010000000000000002  img/s: 5142.786508673953  loss: 0.0156 (0.0181)  time: 0.0385  data: 0.0039  max mem: 281\n",
            "2021/05/21 22:25:22\tINFO\ttorchdistill.misc.log\tEpoch: [163] Total time: 0:00:16\n",
            "2021/05/21 22:25:22\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:49  acc1: 92.9688 (92.9688)  acc5: 100.0000 (100.0000)  time: 0.6247  data: 0.6020  max mem: 281\n",
            "2021/05/21 22:25:24\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:25:24\tINFO\t__main__\t * Acc@1 91.9300\tAcc@5 99.7500\n",
            "\n",
            "2021/05/21 22:25:25\tINFO\ttorchdistill.misc.log\tEpoch: [164]  [  0/391]  eta: 0:05:54  lr: 0.0010000000000000002  img/s: 1167.097992413126  loss: 0.0209 (0.0209)  time: 0.9065  data: 0.7968  max mem: 281\n",
            "2021/05/21 22:25:30\tINFO\ttorchdistill.misc.log\tEpoch: [164]  [100/391]  eta: 0:00:15  lr: 0.0010000000000000002  img/s: 3070.5182931362847  loss: 0.0186 (0.0194)  time: 0.0407  data: 0.0049  max mem: 281\n",
            "2021/05/21 22:25:34\tINFO\ttorchdistill.misc.log\tEpoch: [164]  [200/391]  eta: 0:00:09  lr: 0.0010000000000000002  img/s: 4456.247816992596  loss: 0.0177 (0.0192)  time: 0.0415  data: 0.0042  max mem: 281\n",
            "2021/05/21 22:25:38\tINFO\ttorchdistill.misc.log\tEpoch: [164]  [300/391]  eta: 0:00:04  lr: 0.0010000000000000002  img/s: 3039.9014314187352  loss: 0.0138 (0.0190)  time: 0.0417  data: 0.0052  max mem: 281\n",
            "2021/05/21 22:25:41\tINFO\ttorchdistill.misc.log\tEpoch: [164] Total time: 0:00:17\n",
            "2021/05/21 22:25:42\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:46  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5933  data: 0.5705  max mem: 281\n",
            "2021/05/21 22:25:44\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:25:44\tINFO\t__main__\t * Acc@1 91.8300\tAcc@5 99.7600\n",
            "\n",
            "2021/05/21 22:25:44\tINFO\ttorchdistill.misc.log\tEpoch: [165]  [  0/391]  eta: 0:04:20  lr: 0.0010000000000000002  img/s: 1242.2765088495883  loss: 0.0156 (0.0156)  time: 0.6657  data: 0.5626  max mem: 281\n",
            "2021/05/21 22:25:49\tINFO\ttorchdistill.misc.log\tEpoch: [165]  [100/391]  eta: 0:00:15  lr: 0.0010000000000000002  img/s: 3769.869687032603  loss: 0.0135 (0.0190)  time: 0.0408  data: 0.0041  max mem: 281\n",
            "2021/05/21 22:25:53\tINFO\ttorchdistill.misc.log\tEpoch: [165]  [200/391]  eta: 0:00:08  lr: 0.0010000000000000002  img/s: 2681.592519704704  loss: 0.0101 (0.0195)  time: 0.0423  data: 0.0059  max mem: 281\n",
            "2021/05/21 22:25:57\tINFO\ttorchdistill.misc.log\tEpoch: [165]  [300/391]  eta: 0:00:04  lr: 0.0010000000000000002  img/s: 4967.715152861056  loss: 0.0140 (0.0187)  time: 0.0387  data: 0.0029  max mem: 281\n",
            "2021/05/21 22:26:01\tINFO\ttorchdistill.misc.log\tEpoch: [165] Total time: 0:00:16\n",
            "2021/05/21 22:26:01\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:45  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5737  data: 0.5427  max mem: 281\n",
            "2021/05/21 22:26:03\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:26:03\tINFO\t__main__\t * Acc@1 91.8800\tAcc@5 99.7300\n",
            "\n",
            "2021/05/21 22:26:04\tINFO\ttorchdistill.misc.log\tEpoch: [166]  [  0/391]  eta: 0:06:09  lr: 0.0010000000000000002  img/s: 985.3699090745574  loss: 0.0092 (0.0092)  time: 0.9444  data: 0.8145  max mem: 281\n",
            "2021/05/21 22:26:08\tINFO\ttorchdistill.misc.log\tEpoch: [166]  [100/391]  eta: 0:00:15  lr: 0.0010000000000000002  img/s: 4220.915553528889  loss: 0.0160 (0.0179)  time: 0.0413  data: 0.0048  max mem: 281\n",
            "2021/05/21 22:26:12\tINFO\ttorchdistill.misc.log\tEpoch: [166]  [200/391]  eta: 0:00:08  lr: 0.0010000000000000002  img/s: 3450.6820238584946  loss: 0.0175 (0.0185)  time: 0.0393  data: 0.0045  max mem: 281\n",
            "2021/05/21 22:26:16\tINFO\ttorchdistill.misc.log\tEpoch: [166]  [300/391]  eta: 0:00:04  lr: 0.0010000000000000002  img/s: 3367.038438623008  loss: 0.0185 (0.0185)  time: 0.0423  data: 0.0056  max mem: 281\n",
            "2021/05/21 22:26:20\tINFO\ttorchdistill.misc.log\tEpoch: [166] Total time: 0:00:16\n",
            "2021/05/21 22:26:20\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:51  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.6560  data: 0.6305  max mem: 281\n",
            "2021/05/21 22:26:22\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:26:22\tINFO\t__main__\t * Acc@1 91.9000\tAcc@5 99.7400\n",
            "\n",
            "2021/05/21 22:26:23\tINFO\ttorchdistill.misc.log\tEpoch: [167]  [  0/391]  eta: 0:06:15  lr: 0.0010000000000000002  img/s: 915.5260970622793  loss: 0.0143 (0.0143)  time: 0.9606  data: 0.8207  max mem: 281\n",
            "2021/05/21 22:26:28\tINFO\ttorchdistill.misc.log\tEpoch: [167]  [100/391]  eta: 0:00:15  lr: 0.0010000000000000002  img/s: 2577.99920288498  loss: 0.0148 (0.0207)  time: 0.0409  data: 0.0037  max mem: 281\n",
            "2021/05/21 22:26:32\tINFO\ttorchdistill.misc.log\tEpoch: [167]  [200/391]  eta: 0:00:08  lr: 0.0010000000000000002  img/s: 4064.217294866651  loss: 0.0144 (0.0191)  time: 0.0395  data: 0.0047  max mem: 281\n",
            "2021/05/21 22:26:36\tINFO\ttorchdistill.misc.log\tEpoch: [167]  [300/391]  eta: 0:00:04  lr: 0.0010000000000000002  img/s: 4284.615664554436  loss: 0.0167 (0.0187)  time: 0.0415  data: 0.0061  max mem: 281\n",
            "2021/05/21 22:26:39\tINFO\ttorchdistill.misc.log\tEpoch: [167] Total time: 0:00:16\n",
            "2021/05/21 22:26:40\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:48  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.6133  data: 0.5809  max mem: 281\n",
            "2021/05/21 22:26:41\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:26:41\tINFO\t__main__\t * Acc@1 92.0200\tAcc@5 99.7600\n",
            "\n",
            "2021/05/21 22:26:42\tINFO\ttorchdistill.misc.log\tEpoch: [168]  [  0/391]  eta: 0:04:03  lr: 0.0010000000000000002  img/s: 1099.5211980085076  loss: 0.0492 (0.0492)  time: 0.6236  data: 0.5071  max mem: 281\n",
            "2021/05/21 22:26:47\tINFO\ttorchdistill.misc.log\tEpoch: [168]  [100/391]  eta: 0:00:15  lr: 0.0010000000000000002  img/s: 3878.5646004912587  loss: 0.0153 (0.0194)  time: 0.0383  data: 0.0067  max mem: 281\n",
            "2021/05/21 22:26:51\tINFO\ttorchdistill.misc.log\tEpoch: [168]  [200/391]  eta: 0:00:08  lr: 0.0010000000000000002  img/s: 3525.0186273415493  loss: 0.0140 (0.0194)  time: 0.0401  data: 0.0035  max mem: 281\n",
            "2021/05/21 22:26:55\tINFO\ttorchdistill.misc.log\tEpoch: [168]  [300/391]  eta: 0:00:04  lr: 0.0010000000000000002  img/s: 3365.2022866312304  loss: 0.0136 (0.0196)  time: 0.0447  data: 0.0059  max mem: 281\n",
            "2021/05/21 22:26:58\tINFO\ttorchdistill.misc.log\tEpoch: [168] Total time: 0:00:16\n",
            "2021/05/21 22:26:59\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:50  acc1: 92.9688 (92.9688)  acc5: 100.0000 (100.0000)  time: 0.6351  data: 0.6166  max mem: 281\n",
            "2021/05/21 22:27:01\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:27:01\tINFO\t__main__\t * Acc@1 91.8000\tAcc@5 99.7700\n",
            "\n",
            "2021/05/21 22:27:02\tINFO\ttorchdistill.misc.log\tEpoch: [169]  [  0/391]  eta: 0:04:29  lr: 0.0010000000000000002  img/s: 1116.1627037174867  loss: 0.0591 (0.0591)  time: 0.6885  data: 0.5738  max mem: 281\n",
            "2021/05/21 22:27:07\tINFO\ttorchdistill.misc.log\tEpoch: [169]  [100/391]  eta: 0:00:16  lr: 0.0010000000000000002  img/s: 4336.8438603152035  loss: 0.0154 (0.0178)  time: 0.0436  data: 0.0043  max mem: 281\n",
            "2021/05/21 22:27:11\tINFO\ttorchdistill.misc.log\tEpoch: [169]  [200/391]  eta: 0:00:09  lr: 0.0010000000000000002  img/s: 3505.4776431257837  loss: 0.0188 (0.0179)  time: 0.0410  data: 0.0039  max mem: 281\n",
            "2021/05/21 22:27:15\tINFO\ttorchdistill.misc.log\tEpoch: [169]  [300/391]  eta: 0:00:04  lr: 0.0010000000000000002  img/s: 2844.921955148586  loss: 0.0154 (0.0180)  time: 0.0429  data: 0.0045  max mem: 281\n",
            "2021/05/21 22:27:19\tINFO\ttorchdistill.misc.log\tEpoch: [169] Total time: 0:00:17\n",
            "2021/05/21 22:27:19\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:50  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.6424  data: 0.6186  max mem: 281\n",
            "2021/05/21 22:27:21\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:27:21\tINFO\t__main__\t * Acc@1 91.8400\tAcc@5 99.6700\n",
            "\n",
            "2021/05/21 22:27:22\tINFO\ttorchdistill.misc.log\tEpoch: [170]  [  0/391]  eta: 0:04:09  lr: 0.0010000000000000002  img/s: 1136.01354233673  loss: 0.0208 (0.0208)  time: 0.6386  data: 0.5259  max mem: 281\n",
            "2021/05/21 22:27:27\tINFO\ttorchdistill.misc.log\tEpoch: [170]  [100/391]  eta: 0:00:15  lr: 0.0010000000000000002  img/s: 3336.4877788066547  loss: 0.0122 (0.0193)  time: 0.0391  data: 0.0035  max mem: 281\n",
            "2021/05/21 22:27:31\tINFO\ttorchdistill.misc.log\tEpoch: [170]  [200/391]  eta: 0:00:09  lr: 0.0010000000000000002  img/s: 2651.842965246083  loss: 0.0148 (0.0183)  time: 0.0394  data: 0.0035  max mem: 281\n",
            "2021/05/21 22:27:35\tINFO\ttorchdistill.misc.log\tEpoch: [170]  [300/391]  eta: 0:00:04  lr: 0.0010000000000000002  img/s: 4004.765937131689  loss: 0.0128 (0.0184)  time: 0.0400  data: 0.0045  max mem: 281\n",
            "2021/05/21 22:27:38\tINFO\ttorchdistill.misc.log\tEpoch: [170] Total time: 0:00:17\n",
            "2021/05/21 22:27:39\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:44  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5692  data: 0.5288  max mem: 281\n",
            "2021/05/21 22:27:41\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:27:41\tINFO\t__main__\t * Acc@1 92.0100\tAcc@5 99.7400\n",
            "\n",
            "2021/05/21 22:27:42\tINFO\ttorchdistill.misc.log\tEpoch: [171]  [  0/391]  eta: 0:05:24  lr: 0.0010000000000000002  img/s: 1125.980566397443  loss: 0.0102 (0.0102)  time: 0.8291  data: 0.7154  max mem: 281\n",
            "2021/05/21 22:27:46\tINFO\ttorchdistill.misc.log\tEpoch: [171]  [100/391]  eta: 0:00:15  lr: 0.0010000000000000002  img/s: 2781.6425066708116  loss: 0.0145 (0.0194)  time: 0.0408  data: 0.0063  max mem: 281\n",
            "2021/05/21 22:27:50\tINFO\ttorchdistill.misc.log\tEpoch: [171]  [200/391]  eta: 0:00:08  lr: 0.0010000000000000002  img/s: 3558.7124041336065  loss: 0.0135 (0.0191)  time: 0.0398  data: 0.0051  max mem: 281\n",
            "2021/05/21 22:27:54\tINFO\ttorchdistill.misc.log\tEpoch: [171]  [300/391]  eta: 0:00:04  lr: 0.0010000000000000002  img/s: 3790.5778455585914  loss: 0.0177 (0.0189)  time: 0.0412  data: 0.0060  max mem: 281\n",
            "2021/05/21 22:27:58\tINFO\ttorchdistill.misc.log\tEpoch: [171] Total time: 0:00:16\n",
            "2021/05/21 22:27:58\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:47  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5963  data: 0.5585  max mem: 281\n",
            "2021/05/21 22:28:00\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:28:00\tINFO\t__main__\t * Acc@1 91.8200\tAcc@5 99.7300\n",
            "\n",
            "2021/05/21 22:28:01\tINFO\ttorchdistill.misc.log\tEpoch: [172]  [  0/391]  eta: 0:04:05  lr: 0.0010000000000000002  img/s: 1243.6952700417444  loss: 0.0196 (0.0196)  time: 0.6270  data: 0.5240  max mem: 281\n",
            "2021/05/21 22:28:06\tINFO\ttorchdistill.misc.log\tEpoch: [172]  [100/391]  eta: 0:00:15  lr: 0.0010000000000000002  img/s: 3343.2195535074884  loss: 0.0160 (0.0198)  time: 0.0410  data: 0.0045  max mem: 281\n",
            "2021/05/21 22:28:10\tINFO\ttorchdistill.misc.log\tEpoch: [172]  [200/391]  eta: 0:00:08  lr: 0.0010000000000000002  img/s: 5584.029289399235  loss: 0.0127 (0.0183)  time: 0.0413  data: 0.0066  max mem: 281\n",
            "2021/05/21 22:28:14\tINFO\ttorchdistill.misc.log\tEpoch: [172]  [300/391]  eta: 0:00:04  lr: 0.0010000000000000002  img/s: 4002.3476542988988  loss: 0.0170 (0.0179)  time: 0.0395  data: 0.0037  max mem: 281\n",
            "2021/05/21 22:28:17\tINFO\ttorchdistill.misc.log\tEpoch: [172] Total time: 0:00:16\n",
            "2021/05/21 22:28:18\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:46  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5894  data: 0.5498  max mem: 281\n",
            "2021/05/21 22:28:19\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:28:19\tINFO\t__main__\t * Acc@1 91.8900\tAcc@5 99.7200\n",
            "\n",
            "2021/05/21 22:28:20\tINFO\ttorchdistill.misc.log\tEpoch: [173]  [  0/391]  eta: 0:04:18  lr: 0.0010000000000000002  img/s: 1015.633376024154  loss: 0.0172 (0.0172)  time: 0.6602  data: 0.5341  max mem: 281\n",
            "2021/05/21 22:28:25\tINFO\ttorchdistill.misc.log\tEpoch: [173]  [100/391]  eta: 0:00:15  lr: 0.0010000000000000002  img/s: 4183.094613652478  loss: 0.0111 (0.0191)  time: 0.0411  data: 0.0033  max mem: 281\n",
            "2021/05/21 22:28:29\tINFO\ttorchdistill.misc.log\tEpoch: [173]  [200/391]  eta: 0:00:09  lr: 0.0010000000000000002  img/s: 3671.9667323265485  loss: 0.0149 (0.0173)  time: 0.0397  data: 0.0050  max mem: 281\n",
            "2021/05/21 22:28:33\tINFO\ttorchdistill.misc.log\tEpoch: [173]  [300/391]  eta: 0:00:04  lr: 0.0010000000000000002  img/s: 3191.5567603557333  loss: 0.0118 (0.0176)  time: 0.0389  data: 0.0044  max mem: 281\n",
            "2021/05/21 22:28:36\tINFO\ttorchdistill.misc.log\tEpoch: [173] Total time: 0:00:16\n",
            "2021/05/21 22:28:37\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:46  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5824  data: 0.5614  max mem: 281\n",
            "2021/05/21 22:28:39\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:28:39\tINFO\t__main__\t * Acc@1 91.8300\tAcc@5 99.7600\n",
            "\n",
            "2021/05/21 22:28:40\tINFO\ttorchdistill.misc.log\tEpoch: [174]  [  0/391]  eta: 0:05:01  lr: 0.0010000000000000002  img/s: 1122.0130703109162  loss: 0.0267 (0.0267)  time: 0.7707  data: 0.6566  max mem: 281\n",
            "2021/05/21 22:28:44\tINFO\ttorchdistill.misc.log\tEpoch: [174]  [100/391]  eta: 0:00:15  lr: 0.0010000000000000002  img/s: 3046.7675614323816  loss: 0.0148 (0.0188)  time: 0.0402  data: 0.0039  max mem: 281\n",
            "2021/05/21 22:28:48\tINFO\ttorchdistill.misc.log\tEpoch: [174]  [200/391]  eta: 0:00:08  lr: 0.0010000000000000002  img/s: 5177.603765032645  loss: 0.0138 (0.0179)  time: 0.0394  data: 0.0038  max mem: 281\n",
            "2021/05/21 22:28:52\tINFO\ttorchdistill.misc.log\tEpoch: [174]  [300/391]  eta: 0:00:04  lr: 0.0010000000000000002  img/s: 2265.8613060745593  loss: 0.0126 (0.0178)  time: 0.0418  data: 0.0061  max mem: 281\n",
            "2021/05/21 22:28:56\tINFO\ttorchdistill.misc.log\tEpoch: [174] Total time: 0:00:16\n",
            "2021/05/21 22:28:56\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:49  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.6249  data: 0.5716  max mem: 281\n",
            "2021/05/21 22:28:58\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:28:58\tINFO\t__main__\t * Acc@1 91.9000\tAcc@5 99.7500\n",
            "\n",
            "2021/05/21 22:28:59\tINFO\ttorchdistill.misc.log\tEpoch: [175]  [  0/391]  eta: 0:05:16  lr: 0.0010000000000000002  img/s: 1059.6798720972693  loss: 0.0103 (0.0103)  time: 0.8096  data: 0.6888  max mem: 281\n",
            "2021/05/21 22:29:03\tINFO\ttorchdistill.misc.log\tEpoch: [175]  [100/391]  eta: 0:00:15  lr: 0.0010000000000000002  img/s: 4084.50112217649  loss: 0.0235 (0.0186)  time: 0.0396  data: 0.0057  max mem: 281\n",
            "2021/05/21 22:29:07\tINFO\ttorchdistill.misc.log\tEpoch: [175]  [200/391]  eta: 0:00:08  lr: 0.0010000000000000002  img/s: 3562.2306916503  loss: 0.0107 (0.0177)  time: 0.0381  data: 0.0042  max mem: 281\n",
            "2021/05/21 22:29:11\tINFO\ttorchdistill.misc.log\tEpoch: [175]  [300/391]  eta: 0:00:03  lr: 0.0010000000000000002  img/s: 3505.660763725644  loss: 0.0119 (0.0178)  time: 0.0419  data: 0.0049  max mem: 281\n",
            "2021/05/21 22:29:15\tINFO\ttorchdistill.misc.log\tEpoch: [175] Total time: 0:00:16\n",
            "2021/05/21 22:29:15\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:50  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.6416  data: 0.6106  max mem: 281\n",
            "2021/05/21 22:29:17\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:29:17\tINFO\t__main__\t * Acc@1 91.9600\tAcc@5 99.7600\n",
            "\n",
            "2021/05/21 22:29:18\tINFO\ttorchdistill.misc.log\tEpoch: [176]  [  0/391]  eta: 0:04:37  lr: 0.0010000000000000002  img/s: 1228.6584538066675  loss: 0.0159 (0.0159)  time: 0.7101  data: 0.6059  max mem: 281\n",
            "2021/05/21 22:29:23\tINFO\ttorchdistill.misc.log\tEpoch: [176]  [100/391]  eta: 0:00:15  lr: 0.0010000000000000002  img/s: 3459.0414927065617  loss: 0.0198 (0.0203)  time: 0.0402  data: 0.0050  max mem: 281\n",
            "2021/05/21 22:29:27\tINFO\ttorchdistill.misc.log\tEpoch: [176]  [200/391]  eta: 0:00:08  lr: 0.0010000000000000002  img/s: 2187.631053086239  loss: 0.0127 (0.0194)  time: 0.0373  data: 0.0025  max mem: 281\n",
            "2021/05/21 22:29:31\tINFO\ttorchdistill.misc.log\tEpoch: [176]  [300/391]  eta: 0:00:04  lr: 0.0010000000000000002  img/s: 4248.740993985439  loss: 0.0107 (0.0186)  time: 0.0390  data: 0.0048  max mem: 281\n",
            "2021/05/21 22:29:34\tINFO\ttorchdistill.misc.log\tEpoch: [176] Total time: 0:00:16\n",
            "2021/05/21 22:29:35\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:48  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.6077  data: 0.5542  max mem: 281\n",
            "2021/05/21 22:29:37\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:29:37\tINFO\t__main__\t * Acc@1 91.9300\tAcc@5 99.7400\n",
            "\n",
            "2021/05/21 22:29:38\tINFO\ttorchdistill.misc.log\tEpoch: [177]  [  0/391]  eta: 0:05:49  lr: 0.0010000000000000002  img/s: 1254.7905304809785  loss: 0.0306 (0.0306)  time: 0.8944  data: 0.7923  max mem: 281\n",
            "2021/05/21 22:29:42\tINFO\ttorchdistill.misc.log\tEpoch: [177]  [100/391]  eta: 0:00:15  lr: 0.0010000000000000002  img/s: 4962.89333222404  loss: 0.0172 (0.0182)  time: 0.0400  data: 0.0038  max mem: 281\n",
            "2021/05/21 22:29:46\tINFO\ttorchdistill.misc.log\tEpoch: [177]  [200/391]  eta: 0:00:09  lr: 0.0010000000000000002  img/s: 4006.2003731064847  loss: 0.0168 (0.0199)  time: 0.0413  data: 0.0046  max mem: 281\n",
            "2021/05/21 22:29:50\tINFO\ttorchdistill.misc.log\tEpoch: [177]  [300/391]  eta: 0:00:04  lr: 0.0010000000000000002  img/s: 3867.0823663302863  loss: 0.0138 (0.0194)  time: 0.0396  data: 0.0051  max mem: 281\n",
            "2021/05/21 22:29:54\tINFO\ttorchdistill.misc.log\tEpoch: [177] Total time: 0:00:16\n",
            "2021/05/21 22:29:54\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:47  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.6055  data: 0.5691  max mem: 281\n",
            "2021/05/21 22:29:56\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:29:56\tINFO\t__main__\t * Acc@1 91.8800\tAcc@5 99.7000\n",
            "\n",
            "2021/05/21 22:29:57\tINFO\ttorchdistill.misc.log\tEpoch: [178]  [  0/391]  eta: 0:05:44  lr: 0.0010000000000000002  img/s: 1004.9622103253341  loss: 0.0022 (0.0022)  time: 0.8803  data: 0.7529  max mem: 281\n",
            "2021/05/21 22:30:01\tINFO\ttorchdistill.misc.log\tEpoch: [178]  [100/391]  eta: 0:00:15  lr: 0.0010000000000000002  img/s: 3763.764613507943  loss: 0.0095 (0.0167)  time: 0.0382  data: 0.0035  max mem: 281\n",
            "2021/05/21 22:30:05\tINFO\ttorchdistill.misc.log\tEpoch: [178]  [200/391]  eta: 0:00:08  lr: 0.0010000000000000002  img/s: 3160.425211775856  loss: 0.0152 (0.0165)  time: 0.0398  data: 0.0050  max mem: 281\n",
            "2021/05/21 22:30:09\tINFO\ttorchdistill.misc.log\tEpoch: [178]  [300/391]  eta: 0:00:04  lr: 0.0010000000000000002  img/s: 3047.6496347050106  loss: 0.0127 (0.0165)  time: 0.0404  data: 0.0043  max mem: 281\n",
            "2021/05/21 22:30:13\tINFO\ttorchdistill.misc.log\tEpoch: [178] Total time: 0:00:16\n",
            "2021/05/21 22:30:13\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:45  acc1: 94.5312 (94.5312)  acc5: 100.0000 (100.0000)  time: 0.5799  data: 0.5410  max mem: 281\n",
            "2021/05/21 22:30:15\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:30:15\tINFO\t__main__\t * Acc@1 91.9500\tAcc@5 99.7300\n",
            "\n",
            "2021/05/21 22:30:16\tINFO\ttorchdistill.misc.log\tEpoch: [179]  [  0/391]  eta: 0:05:42  lr: 0.0010000000000000002  img/s: 1053.3014559459136  loss: 0.0157 (0.0157)  time: 0.8762  data: 0.7546  max mem: 281\n",
            "2021/05/21 22:30:21\tINFO\ttorchdistill.misc.log\tEpoch: [179]  [100/391]  eta: 0:00:15  lr: 0.0010000000000000002  img/s: 4444.148471904904  loss: 0.0148 (0.0183)  time: 0.0387  data: 0.0051  max mem: 281\n",
            "2021/05/21 22:30:25\tINFO\ttorchdistill.misc.log\tEpoch: [179]  [200/391]  eta: 0:00:08  lr: 0.0010000000000000002  img/s: 4327.9985811715005  loss: 0.0154 (0.0174)  time: 0.0411  data: 0.0049  max mem: 281\n",
            "2021/05/21 22:30:29\tINFO\ttorchdistill.misc.log\tEpoch: [179]  [300/391]  eta: 0:00:03  lr: 0.0010000000000000002  img/s: 5396.826586515747  loss: 0.0140 (0.0173)  time: 0.0386  data: 0.0039  max mem: 281\n",
            "2021/05/21 22:30:32\tINFO\ttorchdistill.misc.log\tEpoch: [179] Total time: 0:00:16\n",
            "2021/05/21 22:30:33\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:50  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.6407  data: 0.5686  max mem: 281\n",
            "2021/05/21 22:30:34\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:30:34\tINFO\t__main__\t * Acc@1 91.8800\tAcc@5 99.7300\n",
            "\n",
            "2021/05/21 22:30:35\tINFO\ttorchdistill.misc.log\tEpoch: [180]  [  0/391]  eta: 0:04:22  lr: 0.0010000000000000002  img/s: 1071.7847450555287  loss: 0.0150 (0.0150)  time: 0.6718  data: 0.5523  max mem: 281\n",
            "2021/05/21 22:30:40\tINFO\ttorchdistill.misc.log\tEpoch: [180]  [100/391]  eta: 0:00:15  lr: 0.0010000000000000002  img/s: 3998.472558818491  loss: 0.0115 (0.0158)  time: 0.0413  data: 0.0055  max mem: 281\n",
            "2021/05/21 22:30:44\tINFO\ttorchdistill.misc.log\tEpoch: [180]  [200/391]  eta: 0:00:08  lr: 0.0010000000000000002  img/s: 3200.212874267559  loss: 0.0129 (0.0164)  time: 0.0417  data: 0.0047  max mem: 281\n",
            "2021/05/21 22:30:48\tINFO\ttorchdistill.misc.log\tEpoch: [180]  [300/391]  eta: 0:00:04  lr: 0.0010000000000000002  img/s: 2904.7841015458034  loss: 0.0191 (0.0175)  time: 0.0405  data: 0.0054  max mem: 281\n",
            "2021/05/21 22:30:51\tINFO\ttorchdistill.misc.log\tEpoch: [180] Total time: 0:00:16\n",
            "2021/05/21 22:30:52\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:46  acc1: 93.7500 (93.7500)  acc5: 100.0000 (100.0000)  time: 0.5861  data: 0.5420  max mem: 281\n",
            "2021/05/21 22:30:54\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:30:54\tINFO\t__main__\t * Acc@1 91.8900\tAcc@5 99.7000\n",
            "\n",
            "2021/05/21 22:30:54\tINFO\ttorchdistill.misc.log\tEpoch: [181]  [  0/391]  eta: 0:04:25  lr: 0.0010000000000000002  img/s: 867.7150365756289  loss: 0.0053 (0.0053)  time: 0.6793  data: 0.5318  max mem: 281\n",
            "2021/05/21 22:30:59\tINFO\ttorchdistill.misc.log\tEpoch: [181]  [100/391]  eta: 0:00:15  lr: 0.0010000000000000002  img/s: 3642.346262135593  loss: 0.0153 (0.0154)  time: 0.0401  data: 0.0056  max mem: 281\n",
            "2021/05/21 22:31:03\tINFO\ttorchdistill.misc.log\tEpoch: [181]  [200/391]  eta: 0:00:09  lr: 0.0010000000000000002  img/s: 3529.8393241066437  loss: 0.0157 (0.0160)  time: 0.0416  data: 0.0029  max mem: 281\n",
            "2021/05/21 22:31:07\tINFO\ttorchdistill.misc.log\tEpoch: [181]  [300/391]  eta: 0:00:04  lr: 0.0010000000000000002  img/s: 4360.443718882743  loss: 0.0158 (0.0164)  time: 0.0402  data: 0.0067  max mem: 281\n",
            "2021/05/21 22:31:11\tINFO\ttorchdistill.misc.log\tEpoch: [181] Total time: 0:00:16\n",
            "2021/05/21 22:31:11\tINFO\ttorchdistill.misc.log\tValidation:  [ 0/79]  eta: 0:00:43  acc1: 94.5312 (94.5312)  acc5: 100.0000 (100.0000)  time: 0.5482  data: 0.5118  max mem: 281\n",
            "2021/05/21 22:31:13\tINFO\ttorchdistill.misc.log\tValidation: Total time: 0:00:02\n",
            "2021/05/21 22:31:13\tINFO\t__main__\t * Acc@1 91.9500\tAcc@5 99.7400\n",
            "\n",
            "2021/05/21 22:31:13\tINFO\t__main__\tTraining time 0:58:31\n",
            "2021/05/21 22:31:13\tINFO\ttorchdistill.common.main_util\tLoading model parameters\n",
            "2021/05/21 22:31:13\tINFO\t__main__\t[Student: resnet20]\n",
            "2021/05/21 22:31:14\tINFO\ttorchdistill.misc.log\tTest:  [    0/10000]  eta: 1:13:41  acc1: 100.0000 (100.0000)  acc5: 100.0000 (100.0000)  time: 0.4421  data: 0.4071  max mem: 281\n",
            "2021/05/21 22:31:18\tINFO\ttorchdistill.misc.log\tTest:  [ 1000/10000]  eta: 0:00:45  acc1: 100.0000 (92.3077)  acc5: 100.0000 (100.0000)  time: 0.0046  data: 0.0001  max mem: 281\n",
            "2021/05/21 22:31:23\tINFO\ttorchdistill.misc.log\tTest:  [ 2000/10000]  eta: 0:00:38  acc1: 100.0000 (91.9540)  acc5: 100.0000 (99.8501)  time: 0.0045  data: 0.0001  max mem: 281\n",
            "2021/05/21 22:31:27\tINFO\ttorchdistill.misc.log\tTest:  [ 3000/10000]  eta: 0:00:33  acc1: 100.0000 (92.2692)  acc5: 100.0000 (99.6668)  time: 0.0046  data: 0.0001  max mem: 281\n",
            "2021/05/21 22:31:32\tINFO\ttorchdistill.misc.log\tTest:  [ 4000/10000]  eta: 0:00:28  acc1: 100.0000 (92.1270)  acc5: 100.0000 (99.6251)  time: 0.0048  data: 0.0001  max mem: 281\n",
            "2021/05/21 22:31:37\tINFO\ttorchdistill.misc.log\tTest:  [ 5000/10000]  eta: 0:00:23  acc1: 100.0000 (92.1416)  acc5: 100.0000 (99.6001)  time: 0.0047  data: 0.0001  max mem: 281\n",
            "2021/05/21 22:31:42\tINFO\ttorchdistill.misc.log\tTest:  [ 6000/10000]  eta: 0:00:19  acc1: 100.0000 (91.9180)  acc5: 100.0000 (99.6501)  time: 0.0049  data: 0.0002  max mem: 281\n",
            "2021/05/21 22:31:47\tINFO\ttorchdistill.misc.log\tTest:  [ 7000/10000]  eta: 0:00:14  acc1: 100.0000 (92.0011)  acc5: 100.0000 (99.6858)  time: 0.0046  data: 0.0001  max mem: 281\n",
            "2021/05/21 22:31:51\tINFO\ttorchdistill.misc.log\tTest:  [ 8000/10000]  eta: 0:00:09  acc1: 100.0000 (92.1260)  acc5: 100.0000 (99.7000)  time: 0.0046  data: 0.0001  max mem: 281\n",
            "2021/05/21 22:31:56\tINFO\ttorchdistill.misc.log\tTest:  [ 9000/10000]  eta: 0:00:04  acc1: 100.0000 (92.0787)  acc5: 100.0000 (99.7000)  time: 0.0046  data: 0.0001  max mem: 281\n",
            "2021/05/21 22:32:01\tINFO\ttorchdistill.misc.log\tTest: Total time: 0:00:47\n",
            "2021/05/21 22:32:01\tINFO\t__main__\t * Acc@1 92.0800\tAcc@5 99.7200\n",
            "\n"
          ],
          "name": "stdout"
        }
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "3GZ7m79Leusy"
      },
      "source": [
        "## 5. More sample configurations, models, datasets...\n",
        "For CIFAR-10/100 datasets, you can find more [sample configurations](https://github.com/yoshitomo-matsubara/torchdistill/tree/master/configs/sample/) and [models](https://github.com/yoshitomo-matsubara/torchdistill/tree/master/torchdistill/models/classification) in the [***torchdistill***](https://github.com/yoshitomo-matsubara/torchdistill) repository.  \n",
        "If you would like to use larger datasets e.g., **ImageNet** and **COCO** datasets and models in `torchvision` (or your own modules), refer to the [official configurations](https://github.com/yoshitomo-matsubara/torchdistill/tree/master/configs/official) used in some published papers.  \n",
        "Experiments with such large datasets and models will require you to use your own machine due to limited disk space and session time (12 hours for free version and 24 hours for Colab Pro) on Google Colab.\n"
      ]
    },
    {
      "cell_type": "markdown",
      "metadata": {
        "id": "gvbAKogukYMR"
      },
      "source": [
        "# Colab examples for knowledge distillation\n",
        "You can find Colab examples for knowledge distillation experiments in the [***torchdistill***](https://github.com/yoshitomo-matsubara/torchdistill) repository."
      ]
    }
  ]
}